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ABSTRACT 


Joint  robot-human  operations  potentially  inerease  the  effieiency,  effectiveness  and  safety 
of  the  tasks  they  perform.  The  utilization  of  an  autonomous  underwater  vehicle  (AUV)  as 
a  robotic  diver’s  assistant  demands  joint,  dynamic  operations  involving  precise  physical 
interactions  between  an  AUV,  human  divers,  and  the  environment,  which,  in  turn, 
requires  a  robust,  accurate  control  system.  A  robot  acting  as  a  dive  assistant  would 
perform  tasks  such  as  tool  carrying,  worksite  illumination,  or  other  general  assistance 
jobs  that  a  “dive  buddy”  might  perform.  Such  precise  control  of  the  AUV  normally 
requires  accurate  knowledge  of  the  vehicle’s  dynamics;  however,  this  high  level  of 
accuracy  is  difficult  to  obtain  without  the  employment  of  extensive  system  identification 
efforts.  Additionally,  the  utility  of  the  resulting  model  is  greatly  diminished  if 
environmental  conditions  or  vehicle  configuration  change  frequently  or  unexpectedly.  An 
ideal  control  system  allows  the  AUV  to  switch  between  operational  modes  and  objectives 
while  accounting  for  uncertain  environmental  conditions,  payload  configurations,  and 
possible  failures  of  onboard  actuators.  Adaptive  control  has  many  applications  in  the 
underwater  domain  and  can  give  a  robotic  diver’s  assistant  the  flexibility  required  to 
enable  joint  robot-diver  operations.  Therefore,  two  adaptive  control  system  approaches. 
Model  Reference  Adaptive  Control  and  L\  Adaptive  Control,  are  investigated  here  for 
heave  control  of  the  Tethered,  Hovering  Autonomous  Underwater  System. 
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I.  INTRODUCTION 


A,  MOTIVATION 

Research  in  the  field  of  robots  has  given  increasing  prominence  to  the  study  of 
autonomous  underwater  vehicles.  While  academic  and  research  applications  have  long 
been  familiar  with  robotics,  the  military  and  commercial  communities  are  showing 
increased  interest  in  the  capabilities  they  can  offer.  This  interest  is  quickly  raising 
demand  for  robotic  platforms  than  can  work  closely  with  a  human  operator.  In  particular, 
the  benefit  of  leveraging  robotic  platforms  to  aid  divers  in  the  performance  of  their  duties 
is  now  evident  for  diving  communities  such  as  researchers,  marine  engineers,  and  the 
military.  Of  particular  importance  are  the  improved  efficiency,  effectiveness  and  safety 
such  a  system  can  bring  to  these  underwater  operations.  Diving  operations,  occurring  in  a 
sensory  depriving,  isolating,  dynamic  environment,  are  inherently  dangerous.  These 
operations  are  demanding  not  only  on  the  divers  themselves,  but  also  on  the  support  crew 
and  their  resources. 

The  Robotic  Diver’s  Assistant  System  (RDAS)  being  developed  by  the  Naval 
Postgraduate  School’s  (NPS)  Center  for  Autonomous  Vehicle  Research  (CAVR)  could 
alleviate  some  of  the  workload  that  burdens  a  dive  team  by  augmenting  human  operations 
and  engaging  in  tasks  such  as  inspection,  tool  manipulation,  navigation,  or  equipment 
carrying.  These  RDAS  capabilities  have  the  potential  to  particularly  benefit  Navy 
operators  in  Salvage,  Search  and  Rescue,  or  Explosive  Ordinance  Disposal  missions  as 
well  as  NASA  and  other  civilian  communities  such  as  law  enforcement,  commercial 
marine  engineers,  or  scientific  researchers  involved  in  complex  underwater  operations. 
Figure  1 .  demonstrates  the  conditions  in  which  a  RDAS  is  likely  to  operate. 
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Figure  1 .  Divers  in  Close-Quarters  Operations  at  NASA  Aquarius  Reef  Base 

The  ability  to  precisely  control  an  RDAS  is  critical  to  the  success  and  safety  of 
any  underwater  mission.  The  arduous  undersea  environment  subjects  the  vehicle  to  many 
external  disturbances  such  as  current  and  swells.  The  vehicle  will  have  to  overcome  these 
disturbances  and  remain  steady  on  task.  Additionally,  the  potential  for  system  failures 
exists  that  will  change  the  characteristics  of  the  system.  An  inability  to  work  around  or 
overcome  such  failures  risks  the  safety  of  the  diver  or  other  systems  in  their  vicinity  and 
potential  mission  failure.  Alternatively,  and  more  commonly,  the  RDAS  will  be  carrying 
out  missions  requiring  varying  payloads  and  system  configurations  (i.e.,  mid-mission 
changes),  which  will  change  the  system’s  base  dynamic  characteristics  as  well.  A  change 
in  the  AUV’s  payload  configuration  changes  the  vehicle’s  buoyancy,  center  of  mass,  and 
drag.  Any  variation  of  these  parameters,  alone  or  in  combination,  diminishes  the  ability 
of  the  RDAS  to  properly  carry  out  its  mission,  unless  the  on  board  control  system  is 
capable  enough  to  sufficiently  compensate  for  each  of  these  parameter  variations.  As  is 
common  with  many  aircraft  control  system  designs,  it  may  be  possible  to  anticipate  many 
of  the  different  parameter  configurations  that  could  potentially  occur  and  then  develop 
control  systems  configurations  optimized  to  correspond  to  each  individual  scenario.  This 
practice,  known  as  “gain  scheduling”  [1]  is  feasible  when  the  scenarios  are  sufficiently 
foreseeable  and  limited  in  scope;  however,  this  is  usually  not  the  case  for  an  RDAS  that 
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has  to  operate  in  multiple  mission  capaeities.  Gain  scheduling  in  a  THAUS,  under  real- 
world  conditions  is  extremely  difficult  and  burdensome  to  the  point  of  impracticality.  The 
number  of  variables  affecting  the  vehicle’s  dynamics  is  extensive  and  difficult  to 
calculate,  let  alone  account  for  with  a  predefined  gain  table. 

This  research  investigates  an  alternate  control  system  method  suitable  for 
application  in  the  set  of  scenarios  in  which  THAUS  parameter  variation  occurs:  adaptive 
control  is  an  approach  in  which  the  control  system  is  able  to  modify  its  behavior  in 
response  to  changes  in  the  target  system’s  inherent  dynamics,  system  response  to 
environmental  disturbances,  or  platform  failures.  Unlike  traditional  control  approaches, 
adaptive  control  systems  are  able  to  operate  with  a  consistent  design  under  a  variety  of 
configurations  without  the  need  to  retune  control  gains  and,  unlike  gain  scheduling,  no 
library  of  control  parameters  corresponding  to  anticipated  scenarios  is  required.  Adaptive 
control  is  most  practically  used  in  a  system  whose  process  dynamics  vary  unpredictably 
or  that  will  be  operated  in  an  environment  with  inconsistent  disturbances  [1].  Two 
specific  types  of  adaptive  control  will  be  evaluated  in  this  research.  Direct  Model 
Reference  Adaptive  Control  (MRAC)  forces  the  behavior  of  the  target  system  to  mimic 
that  of  a  reference  model.  L\  Adaptive  Control  {L\  AC)  uses  a  predictor  model  to 
estimate  system  states  and  adapts  control  efforts  to  match  this  predictor  system  while 
ensuring  that  the  resulting  control  signals  are  physically  executable.  The  appropriate 
application  of  these  adaptive  control  systems  has  the  potential  to  provide  the  flexible, 
stable,  and  precise  control  required  for  the  successful  operation  of  an  RDAS. 

B,  LITERATURE  REVIEW 

1,  Introduction 

As  a  whole,  the  control  of  unmanned  vehicles  is  concerned  with  the  ability  to 
carry  out  a  desired  task  such  as  moving  to  a  specified  pose  with  both  speed  and  accuracy. 
Research  continues  to  address  challenges  associated  with  this  goal,  such  as  finding 
optimal  control  solutions,  disturbance  rejection,  and  changing  environments.  While  the 
problems  that  have  presented  themselves  are  both  numerous  and  broad,  those  that  are 
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most  relevant  in  this  researeh  concern  system  modeling  and  system  control.  These  two 
problems  go  hand  in  hand  and  improvements  in  one  benefit  the  shortcomings  in  the  other. 

2.  System  Modeling 

Many  researchers  have  focused  on  the  problem  of  developing  an  accurate  system 
model  for  underwater  platforms.  Such  a  model  is  beneficial  since  it  permits  simulation 
and  controller  design  using  a  valid  metric.  The  principal  step  in  the  model  development 
process  is  to  define  a  parametric  model  that  captures  the  relationships  between  the 
various  forces  and  moments  that  act  on  a  body  and  the  resulting  motion  (i.e.,  dynamic 
and  kinematic  models).  These  models  are  often  very  complex  and  require  careful 
consideration  of  many  factors,  such  as  the  ability  to  identify  the  parameters  associated 
with  the  selected  model.  In  the  case  of  marine  systems,  analysis  of  rigid  body  dynamics  is 
insufficient  to  describe  a  system  that  is  also  subject  the  highly  tumultuous  forces  in  the 
underwater  environment.  Hydrodynamic  effects  are  also  necessarily  considered,  resulting 
in  a  model  with  over  200  unknowns.  Fossen  [2]  discusses  a  detailed  approach  for 
developing  kinematic  and  dynamic  models  for  generalized  underwater  vehicles.  This 
generalized  model  is  applied  to  nonlinear  motion  of  a  six  degree  of  freedom  (DOF) 
vehicle  and  contains  components  addressing  rigid  body  and  added  mass,  Coriolis  effects, 
damping  and  restoring  forces. 

3,  System  Modeling  for  THAUS-like  Platforms 

Yuh  [3]  presents  and  evaluates  a  dynamic  model  for  a  six  degree  of  freedom, 
remotely  operated,  underwater  vehicle  used  in  conjunction  with  a  self-tuning  control 
system.  Though  he  recognizes  its  limitations,  Yuh’s  model  incorporates  both  rigid  body 
and  hydrodynamic  forces  in  its  development.  This  model  is  a  specialization  of  the  model 
presented  by  Fossen  [2]  through  the  introduction  of  appropriate  assumptions.  In  previous 
work  at  Naval  Postgraduate  School,  Weiss  [4]  defines  a  simplified  dynamic  model  for  the 
SeaBotix  THAUS  based  on  Fossen’s  approach  and  using  assumptions  similar  to  Yuh. 
This  model  was  developed  using  both  rigid  body  and  hydrodynamic  analysis  and  includes 
added  mass,  fluid  motion,  drag,  weight  and  buoyancy,  and  external  force  effects.  Both 
Yuh  and  Weiss  are  able  to  simplify  their  models  by  making  reasonable  assumptions 
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about  the  vehicle  and  its  operating  characteristics,  such  as  shape,  composition,  symmetry, 
center  and  homogeneity  of  mass,  medium  density  and  turbulence,  and  vehicle  speed. 
Using  similar  assumptions  Caccia  et  al.  [5]  reduce  the  general  dynamic  equation  to  a 
decoupled  model  structure  for  a  single  degree  of  freedom  motion.  Streenan  [6],  a  former 
student  at  NPS,  also  effectively  implements  a  simplified,  decoupled  model  for  planar 
motion  for  investigation  in  diver  tracking.  This  decoupling  allows  for  identification  of 
hydrodynamic  parameters  by  exciting  motion  in  isolated  degrees  of  freedom,  limiting  the 
complexity  of  the  calculations  required  to  solve  for  those  parameters. 

4.  System  Identification 

Model  learning,  also  known  as  system  identification  (SysID),  is  an  integral  step  to 
any  adaptive  control  technique,  including  MRAC  and  L\  AC,  that  provides  the  reference 
and  predictor  models  used  in  the  adaptation  processes.  The  SysID  process  attempts  to 
identify  the  individual  parameters  of  the  dynamic  model,  such  as  drag  coefficients,  by 
deliberately  exciting  a  particular  vehicle  dynamic  and  then  evaluating  the  response.  Two 
basic  categories  of  system  identification  techniques  exist:  offline  and  online.  The  offline 
system  identification  techniques  analyze  a  complete  data  set  of  vehicle  motion  and  selects 
parameters  of  the  dynamic  model  that  best  represent  the  vehicle  motion.  Various 
techniques  are  offered  in  texts  by  Slotine  and  Li  [7]  as  well  as  Astrom  and  Wittenmark 
[1]  and  include  linear  least  squares  regression,  a  method  for  minimizing  compounded 
model  error  with  respect  to  the  data  set,  and  gradient  estimators,  which  minimize  step  to 
step  error.  These  techniques  are  expanded  for  online  application,  which  can  incrementally 
update  parameter  estimates  as  additional  data  is  received.  These  techniques  implicitly 
assume  time  invariant  parameters,  and  techniques  have  been  explored  to  allow  estimation 
of  time -varying  parameters:  forgetting  techniques  can  limit  the  data  set  to  the  most 
recently  available  data  in  order  to  improve  estimation  accuracy. 

5,  SysID  for  THAUS-like  Systems 

Weiss  [4]  applies  these  and  other  techniques  in  the  system  identification  of  the 
SeaBotix  THAUS.  Yang  et  al.  [8]  suggest  methods  for  model  definition  and  parameter 

identification  of  a  complexly  shaped  semi-AUV,  the  CISCREA.  Their  research  borrows 
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primarily  from  Fossen  [2]  in  the  development  of  their  dynamic  models  and  then  focuses 
heavily  on  the  identification  of  hydrodynamic  parameters  via  multiple  software  based 
computational  fluid  dynamics  methods.  Their  methods  avoid  the  use  of  expensive 
experimental  analysis  such  as  tow  tanks,  yet  produce  adequately  accurate  results.  On  the 
other  hand,  Caccia  et  al.  [5]  experimentally  derive  the  dynamic  coefficients  on  the 
ROME  underwater  vehicle.  Their  experiments  carefully  measure  the  vehicle  kinematics 
resultant  from  a  nominal  applied  force.  This  data  is  then  used  to  create  a  “best  fit”  model. 

6,  Control  of  THAUS-like  Platforms 

AUVs  that  operate  in  the  ocean  environment  are  frequently  subjected  to 
uncertainties  due  to  nonlinear  hydrodynamics,  sea  state  disturbances,  or  parameter 
variation.  As  a  result,  a  once  suitable  system  model,  with  accurately  identified 
parameters,  may  no  longer  be  appropriate.  Classical  control  systems,  such  as 
proportional,  derivative  and  integral  controllers  presented  by  Nise  [9],  while  suitable  for 
static,  well  defined  systems,  are  unable  to  properly  control  systems  with  variable 
parameters.  In  this  common  instance,  more  advanced  and  robust  control  methods  such  as 
adaptive  control  are  rightfully  considered.  The  performance  of  an  adaptive  control  system 
is  evaluated  similar  to  classical  systems.  Three  design  objectives  in  modern  control 
theory  are  robustness  (the  ability  function  properly  with  uncertain  or  inaccurate 
parameters,)  stability  (the  ability  to  converge  to  a  steady,  predictable  behavior,)  and  rate 
of  response.  In  the  presence  of  time-varying  parameters  and/or  nonlinear  system 
responses,  classical  control  techniques  fail  to  perform  as  required  while  adaptive 
techniques  prove  capable. 

7.  Adaptive  Control 

The  adaptive  control  methods  investigated  in  current  research  have  potential  to 
provide  the  required  robustness,  stability  and  response  speed  to  the  RDAS  even  in  the 
presence  of  uncertainties  and  time  variant  parameters.  Several  of  the  adaptive  methods 
are  presented  in  texts  by  loannou  and  Sun  [10],  Slotine  and  Li  [7],  and  Astrom  and 
Wittenmark  [1],  including  MRAC  (direct  and  indirect),  and  self-tuning  control.  These 
controllers  ideally  allow  the  system  to  operate  successfully  with  limited  a  priori 
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knowledge  of  the  system  model  and  environment  it  is  operating  in.  The  origin  for 
research  into  adaptive  systems  is  rooted  in  the  development  of  aircraft  control  systems 
operating  in  a  wide  range  of  flight  conditions  [11].  Other  research  on  adaptive  control 
system  implementation  such  as  those  by  Slotine  and  Li  [12]  and  Nicosia  and  Tomei  [13] 
focused  on  industrial  applications  involving  robotic  manipulator  arms  carrying  various 
loads.  The  application  of  adaptive  techniques  has  since  widely  expanded.  Adaptive 
techniques  have  more  recently  come  to  be  applied  to  ground  vehicles  and  aircraft  systems 
and  now  to  marine  vehicles  as  well. 

8.  Adaptive  Control  in  Maritime  Systems 

Work  by  Fossen  and  Sagatun  [14]  demonstrated  the  successful  application  of 
adaptive  techniques  developed  for  robotic  manipulators  and  spacecraft  to  the  NEROV, 
nonlinear,  underwater  robotic  system.  Maalouf  et  al.  [15]  demonstrated  the  more  robust 
performance  of  an  adaptive  controller  versus  a  classical  proportional-derivative  controller 
in  implementation  on  the  Triton-PR  submarine.  Many  variations  of  these  controllers  exist 
as  well;  for  example,  Cheah  et  al.  [16]  have  developed  an  adaptive  Jacobian  controller,  a 
type  of  indirect  MRAC,  designed  to  address  both  kinematic  and  dynamic  uncertainties. 
Further  modification  can  be  made  to  adaptive  controllers  that  are  designed  to  increase  the 
robustness  of  the  systems  in  the  presence  of  high  adaptation  gains.  Sanei  et  al.  [17] 
compare  two  such  modifications:  the  dead-zone  modification,  which  establishes  a 
bounded  range  about  the  reference  command  where  controller  parameter  adjustment  does 
not  occur,  and  the  Projection  Operator  controller,  which  constrains  the  controller 
parameters  and  limits  their  rate  of  change.  Another  modifier,  the  cr -modification,  utilized 
by  Wen  et  al.  [18],  acts  as  an  adaptation  dampener  and  prevents  unstable  changes  to 
controller  parameters.  These  modification  and  variations  attempt  to  address  the  issue  of 
coupling  between  rate  of  adaptation  and  robustness.  Because  they  are  coupled, 
prioritizing  one  metric  requires  sacrificing  performance  in  the  other.  This  shortcoming 
requires  precise  tuning  of  controller  parameters  and  careful  selection  of  reference  models. 
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9.  L\  Adaptive  Control 

While  the  majority  of  adaptive  controllers  seek  to  increase  the  speed  of  adaptation 
and  steady  state  tracking  performance,  these  improvements  often  come  at  the  cost  of 
losing  robustness.  A  more  recently  developed  adaptive  controller,  £iAC  has  been 
introduced  by  Hovakimyan  and  Cao  [19]  to  address  this  coupling  between  rate  of 
adaptation  and  robustness.  A  useful  comparison  of  the  robustness  of  several  adaptive 
controllers  (direct  and  indirect  MRAC,  direct  MRAC  with  the  cr -modification)  with 
£iAC  is  provided.  The  benefit  that  £iAC  provides  is  a  novel  decoupling  of  robustness 
(i.e.,  stable,  accurate  performance),  and  adaptation  and  convergence  speed.  The  £iAC 
architecture  was  recently  implemented  with  success  by  Maalouf  et  al.  [20]  on  an  AC- 
ROV  underwater  vehicle.  This  research  shows  the  XiAC  to  be  a  viable  candidate  for 
AUV  control. 

C.  RESEARCH  OBJECTIVES  AND  SCOPE 

The  goal  of  this  research  is  the  development  of  an  adaptive  control  system  that 
will  enable  an  AUV  to  operate  with  sufficient  precision  to  conduct  joint  human-robot 
missions  as  an  RDAS.  The  capabilities  of  this  control  system  are  characterized  by: 

•  Precise  motion  with  disturbance  rejection 

•  Precise  control  with  configuration  changes 

•  Dynamic  stabilization  for  task  execution 

To  realize  these  goals,  the  following  tasks  were  executed: 

•  Selection  of  a  simplified,  decoupled  dynamic  model  for  use  as  a  reference 
model  and  in  simulation. 

•  Development  of  a  MRAC  and  accompanying  modifications  to  increase 
robustness. 

•  Development  of  a  XiAC. 

•  Implementation  and  experimentation  with  these  controllers  for  evaluation 
and  comparison  on  the  THAUS  robotic  platform. 
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The  thesis  is  structured  as  follows: 


Chapter  II  describes  the  test  platform  being  used,  the  SeaBotix  vLBVSOO.  The 
model  used  on  this  vehicle  is  also  discussed,  starting  with  the  appropriate  kinematic  and 
dynamic  equations  of  motion  and  then  outlining  the  modeling  assumptions  to  obtain  a 
simplified  model. 

Chapter  III  focuses  on  the  development  of  MRAC  and  the  theory  supporting  it. 
An  overview  of  the  controller’s  expected  capabilities  and  limitations  follows.  The  chapter 
also  discusses  the  design  of  simulations  and  experiments. 

Chapter  IV  similarly  discusses  the  development  of  the  £iAC,  its  supporting 
theory  and  expected  performance.  Simulation  and  experimentation  design  are  also 
explained. 

Chapter  V  focuses  on  the  experimental  results  of  the  implementation  of  the 
controllers  from  Chapters  III  and  IV  in  simulation  and  on  the  vehicle.  This  chapter 
includes  discussion  of  the  individual  performance  of  the  controllers  as  well  as  their 
comparative  performance. 

Chapter  VI  then  presents  the  conclusions  of  this  research:  performance 
advantages  and  limitations,  reevaluation  of  goals,  and  recommendations  for  refinement, 
and  future  work.  This  chapter  also  provides  a  brief  summary  of  the  key  points  of  the 
research. 
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II.  AUV  PLANT  MODELING 


A.  SEABOTIX  VLBV300  PLATFORM 

The  vLBVSOO,  a  mini-Remotely  Operated  Vehicle  (ROV),  is  commercially 
available  and  produced  by  SeaBotix,  Inc.  of  San  Diego,  California  (Figure  2.  ).  The 
vLBVSOO  uses  an  open  frame  construction  that  makes  the  vehicle  extremely 
customizable  and  capable  of  incorporating  a  wide  range  of  sensors  and  tools  onto  its 
chassis  with  relative  ease.  Additionally,  due  to  its  vectoring  thrust  and  dynamically  stable 
architecture,  the  vehicle  is  agile  and  steady,  a  necessary  trait  for  robot-diver  operations. 
The  ROV  has  the  key  ability  to  move  laterally,  making  it  especially  well-suited  for 
precise  positioning.  This  versatility  makes  it  a  viable  candidate  for  a  large  selection  of 
missions.  The  unit  is  built  to  be  rugged  as  well,  a  requirement  for  any  military  operation. 
Because  of  these  advantages,  the  U.S.  Navy’s  diving  and  salvage  teams  use  these 
vehicles  in  the  fleet.  SeaBotix  designed  the  vLBVSOO  with  such  utility  in  mind  and 
recommends  the  unit  for  use  in  work  on  offshore  oil  and  gas  structures,  coastal  and 
inshore  surveys,  maritime  security,  and  scientific  research. 


Figure  2.  The  SeaBotix  vLBVSOO  ROV 

1.  System  Configurations 

In  its  base  configuration  the  vehicle  is  operated  by  joystick  via  a  control  interface. 

In  comparison,  the  Tethered  Hovering  Autonomous  Underwater  System  (THAUS)  is  an 

augmented  and  modified  vLBVSOO,  which  can  be  operated  in  a  variety  of  control  modes, 
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including  semi-autonomous  and  fully  autonomous  operations.  In  the  course  of  this 
researeh  the  vehicle  is  operated  in  an  autonomous  mode.  The  eommands  are  relayed  to 
the  vehiele  via  a  tether.  All  sensor  and  eommand  data  is  sent  through  this  eonduit,  which 
also  serves  as  the  power  connection  from  a  surface  stationed  AC  power  source.  The 
tether  also  supports  live  video  feeds,  a  eritieal  eapability  in  many  applieations  of  interest 
to  the  Naval  dive  eommunities.  The  vehicle  operates  freely  in  5-DOF  but  only  four  of 
these  ehannels  are  normally  eonsidered:  surge,  sway,  heave,  and  yaw.  Roll  control  is 
limited,  and  piteh  is  not  eontrollable,  due  to  thruster  configuration.  These  four  channels 
provide  suffieient  eontrol  and  freedom  of  movement  and  are  common  in  hovering  elass 
underwater  vehicles.  A  total  of  six  vectored,  100  mm  diameter  propellers  provide  thrust. 
The  forward  horizontal  thrusters  are  offset  at  an  angle  of  35°  from  eenterline.  Aft 
horizontal  thrusters  are  offset  at  45°.  These  veetored  offsets  allow  the  vehiele  to 
effectively  maneuver  in  the  surge,  sway,  and  yaw  direetions.  Vertical  thrusters  are  offset 
by  18°  from  center  allowing  the  vehiele  to  maneuver  in  the  heave  and  roll  directions; 
however,  roll  motion  is  largely  undesired  and  is  negated  by  the  buoyant  foree  /  weight 
righting  moment  arm.  Figure  3.  depiets  the  vectored  thrust  eonfiguration.  The  vehiele  is 
capable  of  speeds  in  exeess  of  3  knots  at  full  power. 


AFT 


Figure  3.  SeaBotix  vLBV300  Veetored  Thrust  Configuration,  after  [4],  [21] 
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The  nominal  vehicle  specifications,  listed  m  Table  1,  are  provided  by  SeaBotix, 
Inc.  Some  of  these  specifications  will  change  based  on  CAVR’s  specific  sensor  payload 
and  will  be  listed  in  the  next  section. 


Depth  Rating 

300  m 

Length 

625  mm 

Width 

390  nun 

Height 

390  mm 

Diagonal 

551  mm 

Weight  in  Air 

18.1kg 

Maximum  Forward  Thrust 

22.5  kgf 

Maximum  Lateral  Thrust 

15.2  kgf 

Maximum  Vertical  Thrust 

9  kgf 

Table  1.  SeaBotix  vLBVSOO  System  Specifications,  from  [21] 


2.  Onboard  Sensors 

The  vLBV300  ships  with  an  integiated  camera  and  lighting  system  on  a  tilt  unit 
that  feeds  real-tune  video  to  the  siuface  station.  Several  other  afteimarket  sensors  and 
accessories  have  been  added  to  the  system.  A  BlueView  P450-45,  2D  imaging,  foi^ward 
looking  sonar  system  was  added,  weighing  2.6  kg  in  ah  and  0.56  kg  in  water  [22],  and 
gives  the  vehicle  the  ability  to  supplement  search  and  mapping  missions.  Tlie  expanded 
sensor  payload  also  includes  a  combination  of  Inertial  Navigation  System  (INS)  and 
Global  Positionmg  System  (GPS)  provided  by  Greensea  Systems,  Inc.  weighing  8  kg  in 
ah  and  is  nearly  neutrally  buoyant  in  water  [23].  The  INS  incoiporates  a  separate  Doppler 
Velocity  Log  (DVL)  by  Teledyne  RD  Instnmients  Inc. [24],  weighing  4.3  kg  in  ah  and 
0.8  kg  in  water.  The  combhied  weight  of  the  frilly  integiated  system,  including  extra 
ballasting  weight  is  33  kg  m  ah  and  neutially  buoyant  in  water  in  the  nominal 
configiuation.  These  systems  giant  the  vehicle  position  accuracy  necessary  to  operate  in 
the  vicinity  of  divers.  System  specific  accmacies  for  the  INS  and  DVL  are  summarized  in 
Table  2.  In  addition  to  the  sensor  payload,  the  THAUS  is  also  equipped  with  a  claw  like, 
actuated  manipulator.  Integration  of  this  payload  can  be  seen  in  Figme  4. 
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INS  /  GPS 

Position  Accuracy 

0.1%  distance  traveled  RMS 

1.0  rn  /  min  drift 

Depth  Accuracy 

0.01% 

Depth  Range 

0  to  6000  m 

Velocity  Accuracy 

0.2%  ±.001  m/s 

Velocity  Range 

±10  m/s 

DVL 

Velocity  Accuracy  ±0.3%  ±0.2  cm/s 

Velocity  Range  ±9  m/s 

Altitude  Range  0.5  to  81  m 

Table  2.  Summaiy  of  Sensor  Acciuacies,  from  [23],  [24] 


Figme  4.  SeaBotix  vLBV300  (friverted)  with  Customized  Sensor  Payload 


B.  DYNAMIC  EQUATIONS  OF  MOTION  DEVELOPMENT 

Kinematic  and  dynamic  equations  of  motion  are  required  to  describe  the  motion 
of  an  AUV  and  the  forces  and  moments  that  influence  that  motion.  These  general 
equations  are  then  used  to  develop  a  specialized  model  for  the  THAUS,  so  that  we  may 
predict  the  vehicle’s  response  to  different  stimuli,  be  they  commanded  or  distiubances. 
These  equations  are  derived  from  work  by  Fossen  [2]  using  notation  standardized  by  the 
Society  of  Naval  Architects  and  Marine  Engineers,  and  are  sunuuarized  below.  These 
generic  equations  were  simplifred  by  Weiss  [4]  iir  prior  work  for  application  to  the 
THAUS,  resirlting  iir  a  simplified  model  (based  on  relevairt  assrrmptions).  This  model  is 
adopted  here  for  rrse  in  the  development  of  the  control  systems  in  this  research.  The 
derivation  of  this  model,  with  appropriate  assrrmptions,  is  summarized  below. 
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1. 


Coordinate  System  and  State  Vectors 


First,  it  is  necessary  to  define  the  associated  coordinate  systems  to  be  used.  A 
right-handed,  body-fixed  frame  is  established:  +x  pointing  forward  (surge),  +y  pointing 
right  sway),  and  +z  pointing  down  (heave)  as  in  Figure  5.  Rotation  about  the  z-axis  is 
yaw,  rotation  about  the  y-axis  is  pitch,  and  rotation  about  the  x-axis  is  roll. 


Heave 


Figure  5.  SeaBotix  vLBVSOO  Body-Fixed  Coordinate  Frame,  from  [4] 

The  linear  and  angular  motion  velocities,  are  represented  by  vector,  v 

v  =  [u,v,w,p,q,rf  (1) 

where  u  is  the  surge  direction  velocity,  v  is  the  sway  direction  velocity,  w  is  the  heave 
direction  velocity,  p  is  the  angular  rate  about  the  body  frame  x-axis  (roll  rate),  q  is  the 
angular  rate  about  the  body  frame  y-axis  (pitch  rate),  and  r  is  the  angular  rate  about  the 
body  frame  z-axis  (yaw  rate).  Velocities  and  angular  rates  are  represented  in  units  of 
meters  per  second  or  radians  per  second,  respectively. 

The  pose  of  the  vehicle  is  represented  by  vector,  rj 

T]  =  [x,y,z,(l),e,\f/f  (2) 
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where  x,  y,  and  z  are  the  vehicle’s  coordinates  with  respect  to  an  inertial  reference  frame, 
and  ^,6',and^  are  Euler  angels  determined  with  the  “zjx”  convention  with  rotating 
frames.  Positions  and  angles  are  presented  in  units  of  meters  and  radians,  respectively. 

2,  Propulsion  Model 

In  addition  to  using  the  joystick,  the  AUV  can  be  controlled  with  low  level, 
program  based.  Pulse  Width  Modulation  (PWM)  commands  directly  to  the  individual 
thrusters.  The  PWM  commands  can  range  from  -102  to  102  and  are  related  to  thruster 
RPM,  which  translates  to  thrust  (Newtons)  according  to  the  equation. 

Thrust  =  0.006736P1EM^  -  0.03366PWM  +  0.0684  (3) 

Thrust  is  then  further  translated  to  motion  according  to  the  position  and  vectoring 
of  each  individual  thruster.  In  the  equations  that  follow,  F  represents  a  forward  thruster, 
A,  an  after  thruster,  P,  a  port  thruster,  S,  a  starboard  thruster,  and  V,  a  vertical  thruster.  In 
combination,  FP  refers  to  the  thrust  associated  with  the  forward-port  thruster,  etc. 
Additionally,  is  the  offset  angle  for  forward  thrusters,  cc^  is  the  offset  angle  for  aft 

thrusters,  and  f  is  the  offset  angle  for  vertical  thrusters  as  shown  in  Figure  3.  Xprop 
(Equation  (4))  is  the  combined  generated  force  from  the  individual  thrusters  in  the  surge 
direction;  Yp^p  (Equation  (5))  is  the  total  thrust  in  the  sway  direction,  and  Zprop  (Equation 
(6))  is  the  total  thrust  in  the  heave  direction.  Npmp  (Equation  (7))  is  the  total  moment 
generated  about  the  body  frame  z-axis.  Equations  for  the  remaining  degrees  of  freedom 
(Kprop,  moment  about  the  x-axis,  and  Mpmp,  motion  about  the  y-axis)  are  omitted  since 
these  channels  are  not  used  in  this  research.  Finally,  EHi  and  EH2  are  moment  arms 
referring  to  the  distance  between  the  centroid  and  the  aft-forward  and  port-starboard  pairs 
of  propellers,  respectively.  EV  is  the  moment  arm  between  vertical  propellers  and  the 
centroid  [4]. 

^ prop  =  (APca^  +  FPca  f  +  (AS  ca^  +  FS  ca  f  (4) 

Yprop  =  i-FS  sap +  APsaf-  (-FP  sa^  +  APsaf-{VP -VS)s  p  (5) 

Z^,^^={VP  +  VS)cp  (6) 
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(V) 


^ prop  =  (APca^  +FPcaj)LH,  + 

(AS  ca^  +  FS  cUf )  LFI^  + 

(APsa^  +FPsaf)LFI^  + 

(AS  sa^  +  FS  saj)LH2 

Note:  for  simplicity  of  notations*  =  sin(‘),andc‘  =  cos(‘) . 

3,  Assumptions  and  Simplified  Model 

Modeling  the  non-linear  dynamics  of  the  THAUS  requires  that  the  following  two 
equations  be  solved  for  uand  j]  ,  as  per  Fossen  [2],  The  first  represents  the  sum  of  forces 
and  moments,  r  ,  on  the  vehicle.  M  is  the  rigid  body  and  added  mass  term,  C(u)  is  the 
rigid  body  and  added  mass  Coriolis  effects,  D(v)  is  the  damping  term,  and  g(r])  is  the 
reactionary  force  term.  The  second  relates  vehicle  pose  dynamics  to  body  velocities, 
angular  rates,  and  pose.  J(v)  is  a  6x6  rotation  matrix  defined  by  the  Euler  angles. 

Mv  + C(v)v  +  D(v)v  +  g(ri)  =  z 

Tq  =  J(V)V  (9) 

Solving  Equations  (8)  and  (9)  for  (1)  and  (2)  can  be  simplified  by  making  some 
basic  assumptions  about  the  characteristics  of  the  vEBVSOO: 

•  The  tether  has  no  effect  on  vehicle  motion  or  trim. 

•  The  X  and  y  position  of  the  center  of  gravity,  center  of  buoyancy,  and  the 
body-frame  are  coincident.  The  z-position  may  be  offset 

•  The  vehicle  has  a  uniform  mass  distribution. 

•  Three  planes  of  symmetry  exist  on  the  vehicle. 

•  All  motion  occurs  at  low  speed,  fully  submerged. 

•  All  flow  is  completely  turbulent. 

The  application  of  these  assumptions  yields  the  following  coupled,  simplified, 
dynamic  equations  of  motion  for  the  THAEIS  AETV  [4]: 
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X prop  =  {m- X.)u-{m-Y,)vr  +  {m-ZJwq-  X^^^li\u\+{W -B)sme 
Yprop  ={m-Y,)v-{m-  ZJwp  +  {m-X.  )ur  -  7  |^|V  |v|  -{W-B)  cos  6  sin  (p 
^prop  =i^- -(m-X. )uq  +  {m-  Y,)vp  - Z^|^| w| w|  -{W-B) cos 6 cos (p 

Kprop  =(Ix-Kp)p  +  {Y,-ZJwv  +  {I^-Iy+N,+M.)rq 

-Kp\p\P  \p\  +  (ZgW-  z^B)  cos  6' sin  (p  (10) 

={Iy-M^)q  +  {Z^-X^)uw  +  {I,-I,+N^-K^)rp 

kl  +  ^  “  ^hB)  sin  9 

N,rop  =  (4 -N^)r  +  {X^-Y^)uv  +  {I, -I,+K^  -M^)rp 

The  added  mass  terms  are  eontained  in  M ^{u)  =  -diag{\X^Y^Z^KpM^Nj.'\),  Coriolis 
terms  are  defined  in  terms  of  added  mass  variables,  the  dampening  terms  are  eontained  in 

^p\p\^q\q\^r\r\\)-'  ^he  7;^ , /j, , and terms  are  the  first 

moments  of  inertia  and  and  z^  are  the  z-direction,  Cartesian,  body  coordinates  of  the 

center  of  gravity  and  center  of  buoyancy,  respectively.  Additionally,  it  is  assumed  that  the 
vehiele  will  remain  elose  to  level;  therefore,  0~0  and  This  reduces  the  restoring 

forces  to  girf)  =  [0, 0,  -  (W  -  B),  0, 0, 0]^ . 

Within  the  scope  of  this  researeh,  only  the  heave  channel  motion  is  considered. 
This  focus  permits  isolation  of  the  heave  direetion  dynamic  equations  of  motion.  Since 
the  heave  channel  can  be  excited  independently,  the  other  channels  and  eoupling  terms 
ean  be  ignored  (they  are  not  excited).  The  application  of  these  final  assumptions  yields 
this  simplified  heave  motion  equation, 

^prop=im-Z^)w-Z^^^^w\w\-gX'n)  (11) 

where  m  is  the  system  mass,  Z^  is  the  added  mass,  and  is  the  quadratie  dampening 
term,  and  g^{q)  is  the  restoring  foree  term  equal  to  Weight  -  Buoyancy  .  This  equation 
will  be  used  later  in  Chapter  111  to  represent  the  referenee  model  in  both  simulation  and 
experimental  trials. 
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4,  System  Identification 

The  final  step  in  developing  an  acceptable  system  model  that  can  be  used  in  a 
simulator  and  during  the  controller  design  process  is  to  solve  for  the  unknown 
parameters:  the  added  mass  and  dampening  terms.  While  we  expect  these  parameters  to 
change  in  actual  operations,  identifying  the  terms  for  a  nominal  system  allows  us  to  use 
this  model  as  a  reference  for  an  MRAC  system,  as  a  predictor  for  the  L\  AC  system,  and 
for  performance  analysis.  The  Linear  Least  Squares  (LLS)  method  is  used  to  estimate  the 
unknown  parameters  [1]. 

Equation  (11)  can  be  rearranged  as 


w- - ^ 


m-Z, 


■w|  w|  + 


^  prop 


iZprop+g.in)) 


(12) 


and  then  written  ii 


j;  =  0*0^ 


(13) 


where  y  =  w  is  the  first  time  derivative  of  z-axis  velocity,  O  =  [w  |  w  |,  +  g^(7))]  is 


Z  I  w  I  1 

measured  experimentally,  and  0  =  [— -  - ]  is  the  set  of  unknown  parameters. 

m  -  Z-  m  -  Z- 


The  LLS  algorithm  seeks  to  minimize  the  square  of  the  error  between  the  measured  and 
modeled  system  response  {s.  =  y,.  -  0 .0,.^  and  i  =  1,2,.. n  observations)  with  respect  to  0, 
according  to  the  cost  function,  V (0,  n) : 


V{e,n) 


(14) 


This  cost  function  is  minimized  by 

0  =  (O^O )-'(!)  ^7 

which  is  also  the  estimated  solution  for  the  system’s  unknown  parameters. 


(15) 
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5,  Experimental  SysID 

A  simple  experiment  was  designed  to  estimate  the  parameters  present  in  the 
model  in  Equation  (12),  0.  Starting  at  approximately  0  m/s,  a  step  command  was  passed 
to  the  THAUS,  equating  to  a  percentage  of  maximum  force.  The  THAUS  would  then 
accelerate  and  settle  to  a  new  steady  state  velocity  (open-loop  control).  Measured 
velocity  data  was  differentiated  to  obtain  w.  This  data  allowed  for  calculations  in  terms 
of  Equation  (13),  and  then  for  calculating  a  solution  via  the  EES  method  in  Equation  (15) 
.  This  process  was  repeated  for  3  z-force  step  inputs:  30%,  50%,  and  80%  of  maximum 
with  the  THAUS  in  a  neutrally  buoyant  condition.  After  calculating  the  unknown  terms, 
the  generated  models,  as  well  as  an  average  model,  were  compared  to  measured  data  to 
find  the  “best  fit”  model.  The  model  selected  corresponds  to  the  30%  step  input  data. 
This  model  provides  the  best  fit  to  all  data  sets,  especially  to  the  30%  step  data,  as 
expected.  Additionally,  this  model  is  favored  because  the  THAUS  will  more  commonly 
be  operated  at  low  speeds  with  z  velocity  in  a  range  of  less  than  50%  of  maximum.  The 
results  of  data  are  shown  in  figure  6.  The  selected  model  is  the  thick  red  line.  The 
experimental,  measured  data  is  the  thick  blue  line.  The  selected  model  equates  to  a 

solution  where  0  =  [  — 0.4645  0.0036].  The  model  parameters  calculated  from  this 
identification  are:  =-244.3629  and  =-128.8485  using  a  vehicle  mass  of  33  kg. 

The  parameters  calculated  for  50%  force  are:  =  -267.9320  and  =  -1 1 1.9450 .  The 
parameters  calculated  for  80%  force  are:  =  -281.3205  and  Z^^  =  -103.4917 . 
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Speed  [rrVs] 


30%  Force 


Figure  6.  Experimental  System  Identifieation  Best  Fit  Model  Results 
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III.  MODEL  REFERENCE  ADAPTIVE  CONTROL  SYSTEM 


A,  DEVELOPMENT 

1,  Overview 

A  direct  model  reference  adaptive  control  system  is  generally  composed  of  four 
primary  parts.  The  plant  is  the  system  to  be  controlled,  that  often  contains  unknown, 
unmodeled,  or  incompletely  modeled  dynamic  parameters;  however,  the  basic  structure 
of  the  dynamic  model  is  assumed  to  be  known.  The  reference  model  is  a  system  with  a 
known  dynamic  model,  whose  response  to  a  command  signal  specifies  the  desired 
behavior  of  the  plant.  In  order  to  be  useful,  the  reference  model’s  performance  must  also 
be  dynamically  achievable  by  the  plant.  The  controller  sends  a  modified  command  signal 
to  the  plant  and  may  contain  a  number  of  parameters  that  are  allowed  to  vary.  These 
parameters  are  changed  in  order  to  achieve  asymptotic  tracking  convergence  between  the 
plant  and  reference  model.  These  control  parameters  are  changed  according  to  an 
adaptation  law,  which  takes  input  from  the  error  between  the  plant  and  the  model 
reference.  Ideally,  as  the  control  parameters  converge  to  a  solution  that  satisfies  the 
dynamic  equation,  tracking  error  will  trend  toward  zero.  This  MRAC  architecture  is 
direct  because  the  adaptation  mechanism  estimates  and  adjusts  the  controller  parameters, 
vice  estimating  the  actual  unknown  parameters  of  the  plant  and  then  calculating  the 
controller  parameters  from  these  estimates.  Figure  7.  illustrates  the  general  architecture  of 
a  direct  MRAC  system  [7],  [11]. 
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Adaptation  Law 


Figure  7.  Direct  MRAC  General  Architecture,  after  [25] 

2,  System  Plant 

Implementation  of  MRAC  depends  on  knowledge  of  the  dynamic  model  of  the 
system,  derived  from  historical  principles.  This  parametric  model  determines  the  exact 
implementation  used.  The  plant  in  an  MRAC  system  can  be  expressed  generally  as, 

x{t)  =  Ax{t)  +  BA{u{t)  + f{t,x{t))),  x(0)  =  Xo 

(16) 

y{t)  =  C^x{t) 

where  x{t)  g  M”  is  the  system  state  and  u{i)  g  is  the  control  input;  Xq  g  M  is  the  state 
initial  condition,  known  to  be  in  an  arbitrarily  large,  but  bounded  set; 
representing  the  plant’s  dynamics,  and  A>0g]R™’''”  ,  the  diagonal  control  efficiency 

matrix,  contain  unknown  constant  parameters,  while  B  g  W'"  ,  the  control  matrix,  is 
assumed  to  be  known.  System  dynamics  contain  nonlinear  terms,  f{t,x{t)).  From  the 
parametric  model,  the  general  structure  of  these  nonlinear  terms  is  known.  As  a 
consequence,  the  function,  f{t,x{t))  can  be  written  in  terms  of  a  known  basis  function, 

<I)(x(t)) ,  and  unknown  coefficients  0  such  that  /(t,x(^))  =  0^O(x(^)) .  This  is  known  as 
“matched”  uncertainty.  Approaches  exist  to  account  for  unmatched  uncertainty  as  well 
(e.g.,  using  radical  basis  functions,  etc.)  but  these  extensions  are  not  considered  here  [11]. 
These  assumptions  allow  Equation  (18)  to  be  rewritten  from  MRAC  as: 
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x{t)  =  Ax(t)  +  BA(u(t)  +  0^O(x(^))) 
y(t)  =  C^x(t) 


(17) 


3,  Reference  Model 

A  stable  reference  model  is  specified.  The  reference  model  parameters  are 
selected  such  that  the  reference  model  represents  the  ideal,  achievable  system  behavior  in 
response  to  bounded  command  input.  The  reference  model  must  be  achievable  in  that  the 
system  it  represents  must  be  capable  of  responding  in  a  similar  way.  The  desired  response 
of  this  model  is  typically  obtained  using  simpler  control  methods  such  as  designing  a 
feedback  law  that  results  in  the  desired  closed  loop  behavior.  This  equation  describes  the 
dynamic  behavior  of  the  system  as  a  first  order  differential  equation; 


where  e  W"  is  Hurwitz,  B^  e  R""'"' ,  and  r{t)  g  is  the  time  dependent,  bounded, 
reference  command  input.  A^  is  chosen  to  best  express  the  desired  system  dynamics.  B^ 


is  calculated  according  to  the  equation,  B^  =  ,where 


-1 

C^AjB 


.  This  calculation 


ensures  steady  state  tracking  error  for  a  step  function  is  zero  and  is  derived  in  Appendix 

C. 


It  will  be  shown  in  Section  B  that  the  dynamics  obtained  in  the  previous  chapter 
can  be  written  in  this  form.  Using  modeled  dynamics  as  the  ideal  basis  establishes  the 
reference  model  as  a  system  with  achievable  performance  with  a  nominal  configuration 
[11]. 


4.  Control  Law 

Once  a  reference  system  has  been  defined,  a  control  law,  u{t)  is  sought  that 
results  in  asymptotic  tracking  of  x  with  respect  to  ;  that  is,  the  tracking  error 
e{t)  =  x(^)  -  (t)  tends  to  zero  as  t  — >  oo  .  The  system  must  be  able  to  track  the  reference 
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model  even  in  the  presenee  of  the  unknown  parameters,  ^,A,and  0 .  The  ideal  eontrol 
solution  for  aehieving  this  performanee,  using  a  feedback  +  feedforward  arehiteeture,  is 

it)  =  Klx{t)  +  <  r  (0  -  0"O(x(O)  ( 1 9) 

whieh,  when  substituted  into  Equation  (19),  beeomes 

x{t)  =  {A  +  BKKl  it))x{t)  +  BKKl  (t)r(t)  (20) 

The  ideal  eontroller  parameters,  (t)  and  (t) ,  can  then  be  ealeulated  by 
solving  Equation  (24),  known  as  the  matehing  eonditions; 

A  +  BAKl(t)^A,„  BAKliD^Bk^^B^  (21) 

These  ideals  eannot  be  attained,  however,  sinee  ^,A,and0  are  unknown.  Instead 
estimates  of  the  quantities  are  used.  In  indireet  MRAC,  ^,A,and  0  are  estimated  instead 

and  then  used  to  ealeulate  K^{t),  K^{t),  and  &(t) .  Direet  MRAC  estimates  the  eontroller 

parameters  direetly.  The  requirement  to  persistently  exeite  the  system  dynamies  for 
indireet  MRAC  makes  direet  MRAC  more  suitable  for  the  THAUS  where  stability  is 
very  important.  In  the  latter  ease,  the  eontroller  parameters  do  not  neeessarily  have  to 
eonverge  to  their  ideal  values  to  drive  traeking  error  to  zero  [7].  The  final  form  of  the 
eontrol  signal  is  then, 

u(t)  =  kl  (t)x(t)  +  kl  (t)  -  ©'■  (0®  WO)  (22) 

and  after  substituting  Equation  (25)into  Equation  (19),  the  system  dynamies  beeome 

x{t)  =  (^  +  Bhkl  it))x{t)  +  BA{kl  (t)r(t)  -  (0(0  -  ©)"'  d>(x(0))  (23) 

Equation  (20)  ean  be  subtraeted  from  Equation  (26)  and  eombined  with  the  matehing 
eonditions  to  produee  the  elosed-loop  traeking  error  dynamies: 

e{t)  =  A^e(t)  +  BA[AK^  (t)x(t)  +  AK^  {t)r{t)  -  A©^  (0d>(x(0)]  (24) 

where  {t)-k^  (t)  -  ,  AK^  (t)  -  k^  (t)  -  ,  and  A0(O  =  0(0  “  ©  are  the  parameter 

estimation  errors  [11]. 
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5. 


Adaptation  Law 


The  controller  parameters  K^(t),  and0(t)  are  estimated  using  adaptation 

laws.  Estimating  correct  controller  parameters  will  cancel  out  the  unknown  plant  gains 
leaving  only  the  reference  model  dynamics  to  be  expressed  by  the  plant,  as  shown  in 
Equation  (26),  thus  leading  to  zero  tracking  error.  Essentially,  once 
^0,  ^0,  and  A0(t)  ^0,  steady  state  tracking  error  tends  to  zero 

globally,  uniformly,  and  asymptotically;  lim  ||  e(t)  ||=  0  ,  as  proven  by  Theorem  9.2  in 

r— >00 

[11]. 

The  three  unknowns  controller  parameters,  K^(t),  K^(t),  and  0(t)  ,  are  calculated 
with  the  equations, 

K^{t)  =  -T^x{t)e{t)PBsgn{K) 

K  it)  =  -T,r{t)e  {t)PB  sgn(  A)  (25) 

0(0  =  Eg,  cI)(x(0)e(0^5sgn(A) 

where  E^,  E^,  and E^  are  the  adaptation  gains  that  determine  the  adaptation  rates.  P  is  the 

solution  to  the  Eyapunov  equation,  Aj  P+PA^=-Q,  and  0  e  M"''"  is  an  arbitrary 

positive  definite  matrix  (e.g.,  identity).  These  three  adaptation  laws  incrementally  adjust 
the  control  gains,  improving  on  the  solutions  to  the  dynamic  equations  and  forcing  the 
plant  to  track  the  behavior  of  reference  model  in  response  to  the  reference  input,  r{t) 
[11]. 


6,  Modifications 

In  the  presence  of  unmatched  disturbances,  the  robustness  of  a  system  can  be 
reduced  as  the  controller  attempts  to  converge  to  a  tracking  solution.  A  phenomenon 
known  as  “parameter  drift”  occurs.  Because  the  control  law  cannot  adequately 
compensate  for  all  of  the  dynamics  of  the  system,  the  controller  parameters, 

A^(t),  K^{t),  and  0(t)  may  continue  to  grow  unbounded  while  the  adaptation  law  seeks 
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a  solution,  even  while  e{t)  remains  bounded.  The  occurrence  of  parameter  drift  is 
problematic  in  that  it  can  result  in  an  overall  increase  in  control  effort  and  the  presence  of 
high  frequency  content  in  the  control  signal.  Two  modifications  are  made  to  the  adaptive 
laws  that  increase  the  robustness  of  the  system.  The  first  is  the  dead  zone  modification 
that  changes  the  adaptation  laws  in  Equation  (25)  slightly; 

K^{t)  =  -T^x{t)mPBsgn{K) 

KXt)  =  -r^  r{t)~e{t)PBsgn{K)  (26) 

4(0  =  r0d>(x(O)e  (0/^5  sgn(A) 


where  e{t)  is  defined  conditionally  according  to  the  relationship  between  e{t)  the  largest 
permissible  error,  5 ; 


e(0  = 


if 

if 


eitms 

em<s 


(27) 


This  modification  helps  to  reduce  oscillations  in  the  control  gains  and  the  control  signal 
by  eliminating  the  adaptation  when  tracking  error  is  sufficiently  small,  while  also 
ensuring  parameter  convergence.  It  requires  acceptance  of  a  non-zero  steady  state 
tracking  error;  however,  this  error  is  typically  tolerably  small  and  can  be  made  arbitrarily 
small  through  careful  selection  of  S  [10]. 

The  second  modification  that  was  used  is  the  Projection  Operator.  The  Projection 
Operator  allows  the  MRAC  system  to  maintain  robustness  in  the  presence  of  uncertain 
dynamics  such  as  unmodeled  parameters,  while  still  allowing  fast  adaptation  and  system 
stability.  The  Projection  Operator,  sometimes  called  an  “anti- windup”  modifier, 
continues  to  modify  the  adaptive  parameters  while  maintaining  uniform  boundedness  of 
the  parameters.  The  parameter  drift  phenomenon  is  halted  by  the  Projection  Operator  at  a 

A 

predefined  limit.  For  an  unknown  parameter,  0  and  its  estimate,  0  ,  established  by  the 
adaptation  law,  6  =  y ,  a  bound,  6^ ,  is  established  such  that  Proj(6',  y  )  operation 
maintains  the  resultant  0  with  the  bounds  of  0^ .  To  achieve  this,  a  function  of  0 ,  and 
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its  gradient  are  defined  in  Equation  (28).  This  function  includes  a  projection  tolerance,  s, 
adding  a  buffer  to  the  estimate  and  scaling  the  function. 


f{e)  = 


(i+^)ll^ir  -e, 


1 

max 


2 

max 


mo) = 


sO, 

2e{\+s) 


(28) 


In  the  event  that  the  adaptation  law,  y,  results  in  a  parameter  estimate,  6  ,  that  lies  outside 
the  defined  bounds,  9^,  the  estimate  is  redirected  to  within  parameter  bounds,  thus 

limiting  the  growth  of  9  ,  and  maintaining  robustness.  This  limitation  is  achieved  by  the 

following  operation,  which  redefines  9  ; 


§  ^  Pj.oj(^  j^)  =  j IIV(^)t  if,  >  0  and  (yV/(^))  >  0] 

[y  otherwise  ^29^ 

Figure  8.  illustrates  the  Projection  Operator.  An  estimate  that  would  result  in  a 
vector  leaving  the  bounded  area  is  then  redirected  along  the  boundary,  9^ .  Similarly,  if 
an  estimate  vector  results  in  a  vector  ending  within  the  projection  zone,  the  Projection 
Operator  redirects  the  vector  to  remain  within  the  9^  bounds. 
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Figure  8.  The  Projeetion  Operator,  from  [11] 


Subsequently,  the  Projection  Operator  is  applied  to  the  adaptation  laws  from 
Equation  (26)  [11],  [25]. 

(0  =  Proj(f ,  (0,  -  r,  x(0  e(0  PB  sgn(  A)) 
kXt)  =  Proj(A^(0,-r^  r(0e(0E5sgn(A))  (30) 

0(0  =  Proj(0(O,rQ  d)(x(0)e(0^^sgn(A)) 
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The  proceeding  calculations  are  now  sunimaiized  in  Table  3. 


Open-loop  Plant 

x{t)  -  Ax(t)  +  BA(u{t)  +  0^O(.r(O)) 
y(t)  =  C^x(0 

Reference  Model 

■'<^J0  =  ^„rJi)  +  B„r(i) 

yJ0  =  c^„-rJ0 

Tracking  Error 

■-*. 

II 

Y 

Control  Signal 

v(r)  =  kf  {t)x{t) + kl  it)  -  ^  (r)O(x(r)) 

k,{t)  =Proj(^,(0,-r,  .r(0e(0^5sgn(A)) 

Adaptation  Laws 

kft)  =  Proj(ie,(0 -r,  r(/)e(0P5sgn(A)) 

0(0  =  Proj(©(0,re  (l)(.r(0)e(/)P5sgn(A)) 

tf  II  <011^'^ 

if  IK0II<^ 

Modiflcations 


Proj((9,v) 


y-l|v/WllV(^)v 

if,  [fid)  >  0  and  iyVfid))  >  0] 
V  otherwise 


Table  3.  MRAC  Design  Summaiy,  after  [11] 


B.  APPLICATION:  THAUS  HEAVE  MODE 

The  MRAC  algorithm  just  developed  was  applied  to  the  THAUS  using  the 
models  previously  estimated  to  represent  the  system  dynamics.  The  plant  model  used  in 
suuulation  is  defined  by  rewriting  Equation  (12)  m  terms  that  better  conelate  with 
Eqiration  (16)  by  addiug  some  umnodeled  parameters; 


if  =  - 


-n’+- 


'wlH 


•n'ht’H- 


(31) 


where  the  linear  damperhng  term  is  introduced  to  correspond  to  the  imknown 

term,  A  .  The  state  variable  .r(f)  corresponds  to  the  z-duectiou  velocity,  w.  System  inpirt 

u(t)  corresponds  to  the  actrrator  force,  Z  .  It  is  assirmed  that  B  =  — ^ — ,  which  gives 

VI -Z^ 

the  nominal  actrrator  effectiveness  and  is  assirmed  to  be  positive,  C—l,  and  yit)  =  n’(t) 
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for  the  single  input,  single  output  system  (SISO).  A  ,  which  represents  the  actual  actuator 
effectiveness,  remains  unknown  but  is  assumed  to  be  positive,  and  the  remaining  terms 
are  written  in  terms  of  the  regressor,  0^O(rv);  g^(;;)]^andd)(w)  =  [w|  w|  1]^  . 


Similarly,  the  reference  model  is  specified  based  on  the  original  parametric 
model;  A^,  has  been  empirically  evaluated  and  chosen  to  be  [-0.4]  in  order  to  express  the 


desired  plant  response,  similar  to  the  nominal  plant;  B^-Bk  - - - — 

m-Z^ 


;  w^{t)  is  the 


model  state  and  r{t)  is  the  command  signal.  Also,  C=1  so  that  for  the  SISO 

system. 


The  control  and  adaptation  laws  maintain  the  same  forms  as  those  expressed  in 
Equations  (22)  and  (30).  Both  the  dead  zone  and  Projection  Operator  modifications  are 
applied.  The  adaptation  gains  selected  for  the  implementation  are; 

=  6e6,  =  2e6,  and  =  6e6 .  The  dead  zone  limiter  is  (5’  =  0.001.  The  Projection 

Operator  bounds  are;  0^_^=\00,0^_^=20Q,dind  ,  while  the  projection 

tolerance  assigned  is  s  =  0.3 .  The  initial  conditions  for  the  controller  parameters 
themselves  are  all  zero  (in  order  to  demonstrate  parameter  learning  and  convergence). 
Additionally,  in  order  to  better  mimic  the  behavior  of  the  real  THAUS,  a  saturation 
limitation  is  placed  on  the  output  of  the  control  signal,  restricting  the  control  effort  to 
±85  Newtons. 


C.  SIMULATION 

The  MRAC  system  was  first  evaluated  in  simulation  using  MATLAB  and 
Simulink  before  implementation  on  the  THAUS.  After  the  development  of  the  MRAC 
formulae  and  application  to  the  system  model,  a  Simulink  model  was  created  to  represent 
the  closed-loop  controller-plant  system,  shown  in  Figure  9.  Detailed  simulation  models 
and  associated  code  are  available  in  Appendix  A.  For  the  real  system,  the  plant  is 
replaced  by  the  commands  sent  to  the  vehicle  and  the  actual  measurements.  This  process 
and  associated  modifications  are  described  in  Chapter  V. 
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Figure  9.  MRAC  Simulink  Model 

1,  MRAC:  Sinusoidal  Command 

The  first  simulation  evaluates  the  MRAC  system’s  response  to  the  sinusoidal 
1  71 

eommand,  r(0  =  —  sin(0.R  + y) .  The  simulation  results  in  Figure  10.  show  a  plant 

response  the  follows  the  referenee  model  fairly  well,  without  signifieant  error.  Due  to  the 
ehoiee  of  the  parameters  in  the  referenee  model,  the  referenee  model  lags  the  eommand 
signal;  however,  the  aetual  plant  follows  the  referenee  model  well.  The  initial  deviation 
oeeurs  during  the  parameter  learning  phase  wherein  the  adaptive  system  learns  the 
unknown  plant  model. 


33 


Figure  10.  MRAC:  Sinusoidal  Command  System  Response 

The  error,  e{t) ,  present  in  the  system  response,  shown  in  Figure  11.  diminishes 
quickly  and  then  remains  reasonably  small.  Error  is  highest  during  the  parameter  learning 
phase,  as  expected.  At  steady  state  error  lies  almost  entirely  within  the  permissible  dead 
zone. 


Error  v  Time 


Figure  11.  MRAC:  Sinusoidal  Command  Error 
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The  controller  parameters  in  Figure  12.  did  not  converge  to  steady  state  values  in 
the  time  frame  of  this  simulation,  but  rather  oscillate  around  their  solutions. 


0  10  20  30  40  50  60  70  80  90  100 

Time  [s] 


Controller  Parameters 


Figure  12.  MRAC:  Sinusoidal  Command  Controller  Parameters 

The  control  signal  is  shown  in  Figure  13.  and  varies  according  to  the  reference 
model  behavior.  Initially,  the  control  signal  oscillates  greatly,  before  controller 
parameters  converge  around  their  solutions.  In  steady  state,  the  response  remains 
relatively  smooth  overall  but  contains  undesirable,  low  amplitude,  high  frequency  content 
and,  importantly,  is  well  bounded  within  the  abilities  of  the  system. 


35 


Figure  13.  MRAC:  Sinusoidal  Command  Control  Signal 

The  simulated  response  of  the  MRAC  system  demonstrates  the  eontrol  system’s 
ability  to  follow  a  referenee  eommand  with  limited  a  priori  knowledge  of  the  plant’s 
dynamie  parameters. 

2,  MRAC:  Time-Varying  Parameters 

The  seeond  simulation  evaluates  the  MRAC  system’s  ability  to  respond  to  a  step 
response  with  r  =  0.5  m/s  and  time-varying  parameters  based  on  the  addition  of  a  0.02 
kg  mass  at  /  =  15  s.  The  system  responds  well  both  to  the  step  eommand  as  well  as  the 
mass  ehange.  The  parameters  of  the  referenee  model  remain  eonstant;  therefore  the 
response  of  the  referenee  model  is  unaffected  and  remains  steady.  Only  plant  parameters 
are  changed  in  order  to  demonstrate  the  controller’s  adaptability. 
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Figure  14.  MRAC:  Time- Varying  Parameters  System  Response 

Though  oscillations  about  the  reference  model  exist,  the  system  reaches  a  steady 
state  error  within  the  dead  zone’s  S ,  as  seen  in  Figure  15. 


Error  v  Time 


Figure  15.  MRAC:  Time- Varying  Parameters  Error 


In  this  instance  of  simulation,  the  adaptation  law  converges  on  a  controller 
parameter  solution;  however,  these  parameters  are  adjusted  in  response  to  the 
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configuration  change  and  settle  at  new  solutions.  Controller  parameters  are  shown  in 
Figure  16.  The  change  in  plant  parameters  themselves  can  be  seen  in  Figure  17. 
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Figure  16.  MRAC:  Time- Varying  Parameters  Controller  Parameters 


Linear  Dampening 


■a  " 
£ 

<  -1 


%  -0  4645 
I  -0  4645 
£  -0,4645 


«  3.6054 


^  3  6052  - 
I  3,605 


0) 

■O  0.2 


1.0.1 

I  0 


15  20 

Time  (s) 

Quadratic  Dampening 


15  20 

Time  (s) 

Mass  Coefficient 


lO  15  21 

Time  |s| 

Restoring  Forces 


10  15  20 

Time  [s] 


25 


30 


Figure  17.  MRAC:  Time- Varying  Parameters 
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The  control  signal,  shown  in  Figure  18.  ,  compensates  as  expected  to  the  step 
response  and  reaches  a  steady  state  value  as  the  vehicle’s  velocity  converges  to  the 
command.  Upon  changing  the  mass,  the  control  signal  changes  to  compensate  for  the 
additional  force  of  the  increased  mass. 


Figure  18.  MRAC:  Time-Varying  Parameters  Control  Signal 

Again,  the  MRAC  system  implementation  demonstrates  the  control  system’s 
ability  to  respond  to  command  signals  as  well  as  a  plant  configuration  change. 
Furthermore,  tuning  of  the  control  gains,  and  bounds  will  improve  the  system  response; 
yet,  limitations  on  the  system’s  potential  do  exist,  as  high  frequency  content  is  again 
present. 

D.  LIMITATIONS 

While  the  MRAC  system  has  the  potential  to  effectively  control  a  THAUS  in  the 
presence  of  uncertain,  time-varying  parameters  and  disturbances,  its  architecture  is  not 
without  drawbacks.  The  most  prominent  limitation  is  the  direct  coupling  of  robustness 
and  adaptation  rate  (i.e.,  the  speed  with  which  it  can  react  to  changes  in  the  system).  Fast 
adaptation  and  response  requires  high  gains  that  drive  the  control  system  to  respond 
quicker,  but  with  a  stronger  control  effort.  A  robust  response  requires  low  gains,  allowing 
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the  controller  to  more  gradually  adapt  and  arrive  at  convergence  without  overshoot  and 
with  minimal  control  effort.  Because  these  two  mechanisms  are  coupled,  a  balance 
between  them  must  be  met,  and  performance  will  be  affected.  Optimal  performance  is 
achieved  by  tuning  the  controller  parameters.  If  a  system  is  tuned  to  favor  speed, 
robustness  will  be  sacrificed.  The  control  response  will  be  fast  but  will  likely  overshoot 
its  target,  resulting  in  high  frequency,  oscillatory  behavior  prior  to  convergence.  In  fact, 
MRAC  does  not  provide  any  guarantees  on  the  transient  response  of  the  system.  If  a 
system  is  tuned  to  favor  robustness,  speed  will  be  sacrificed.  The  control  response  will  be 
smooth,  and  restrained,  but  may  struggle  to  keep  up  with  varying  parameters  or  changing 
commands.  Achieving  steady  state  tracking  will  also  take  longer  since  the  control  effort 
is  unaggressive.  It  is  difficult  to  find  an  optimal  solution  in  the  tuning  process  since  no 
proven  algorithms  exist  for  that  purpose.  Control  parameters  are  often  selected  through 
empirical  evaluation  or  engineering  intuition  [25],  [26]. 

The  stability  of  the  system  response  is  normally  related  to  the  parameter 
estimation  process.  Parameter  estimate  drift  can  cause  the  estimates  to  become 
unbounded.  The  addition  of  modifiers  to  the  adaptation  law,  as  shown  in  Section  A  of 
this  chapter,  alleviates  some  of  the  limitations  of  the  speed/robustness  coupling.  The  dead 
zone  modification  and  the  Projection  Operator  modification  both  allow  for  higher  gains 
to  be  implemented  by  constraining  the  estimates  to  remain  within  a  bounded  set. 

Each  modifier  accomplishes  this  goal  in  its  own  way,  but  both  require  sacrifices 
to  steady  state  tracking  error.  The  dead  zone  modification  establishes  an  acceptable  value 
of  error  thus  leading  to  potentially  constant  steady  state  errors  that  the  system  ignores 
[10].  Similarly,  the  Projection  Operator  has  been  shown  to  increase  robustness  when 
augmented  onto  an  MRAC  system  by  bounding  the  control  parameters;  however, 
bounding  the  parameters  prevents  the  system  from  establishing  a  true  solution.  A  solution 
vector  ending  outside  the  projection  bounds  is  always  redirected  along  the  edge  of  the 
boundaries.  This  results  in  parameters  that  never  truly  solve  the  equation  in  (20)  because 
the  estimate  error  may  never  converge  to  zero,  |  A0  |>0  [11].  Thus,  the  cost  for  keeping 
the  estimates  bounded  is  at  least  a  temporary  deviation  from  the  optimal  reduction  in 
output  error. 
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As  a  potential  solution  to  these  limitations,  L\  AC  is  evaluated  in  the  next  ehapter. 
This  alternative  approaeh  effeetively  deeouples  the  adaptation  properties  of  the  eontroller 
from  the  stability  of  the  controller,  allowing  for  fast  adaptation.  Furthermore,  the 
approach  establishes  some  bounds  on  the  transient  response  of  the  system. 
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IV.  Xi  ADAPTIVE  CONTROL  SYSTEM 


A,  DEVELOPMENT 

1,  Overview 

Originally  proposed  by  Hovakimyan  and  Cao,  the  £i  AC  architecture  decouples 
adaptation  rate  from  robustness  while  obtaining  guaranteed  transient  response. 
Additionally,  £i  AC  eliminates  the  need  for  gain  scheduling,  persistence  of  excitation  or 
high-gain  feedback  control  that  may  result  in  high  frequency  oscillations  in  the  control 
signal.  In  other  words,  £i  AC  attempts  to  address  many  of  the  limitations  associated  with 
MRAC. 

Like  MRAC,  an  £i  AC  system  consists  of  four  main  components.  The  plant  is  the 
target  system  to  be  controlled,  containing  unknown  or  unmodeled  dynamic  parameters.  It 
is  again  useful  to  distinguish  between  matched  and  unmatched  uncertainty  in  the  system; 
this  work  deals  only  with  matched  uncertainty.  The  basic  structure  of  the  plant’s  dynamic 
model  is  generally  known  (normally  derived  from  first  principle).  The  predictor  is  similar 
to  the  MRAC  reference  model,  in  that  it  represents  the  ideal,  achievable  system  behavior 
that  is  to  be  imitated  by  the  efforts  of  the  adaptive  system.  One  important  difference 
between  the  reference  model  and  the  predictor  system  is  that  the  generated  control  signal 
enters  both  the  predictor  and  the  plant,  allowing  additional  flexibility  in  the  design  of  the 
control  law  (as  compared  to  MRAC)  and,  importantly,  the  transient  response  of  the 
system.  The  predictor’s  output  is  compared  to  the  plant  for  use  during  adaptation  (i.e.,  the 
adaptation  law).  The  adaptation  law,  composed  of  a  Projection  Operator  based  equation 
(as  in  the  MRAC  modification),  takes  input  from  the  plant-predictor  error  and  adjusts  the 
control  parameters,  eventually  reaching  convergence  in  a  system  with  constant 
parameters.  The  control  law  generates  a  control  signal,  based  on  commanded  input  and  a 
signal  composed  of  the  adaptive  gains  (defined  explicitly  below).  This  control  signal  is 
passed  through  a  low  pass  filter,  to  eliminate  high  frequency  content  and  increase 
robustness.  Again,  as  control  parameters  converge  to  a  solution  that  satisfies  the  dynamic 
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equation,  tracking  error  will  trend  toward  zero  [25],  [27].  The  general  architecture  for  an 
L\  AC  system  is  shown  in  Figure  19. 


Figure  19.  L\  Adaptive  Control  General  Architecture,  from  [25] 


2,  System  Plant 

The  L\  AC  plant  takes  the  general  form, 

x  =  A^x  +  B{cou{t)+f{t,x{t)))  x(0)  =  Xo 

J  =  C"x(0  ^  ^ 

where  x{t)  G  M”  is  the  system’s  measured  state;  is  a  known  Flurwitz  matrix 

expressing  the  desired  closed-loop  dynamics;  B  and  C  e  M"  are  known  constant  vectors; 
M(t)  G  ]R  is  the  control  signal;  e  Rande  Q  =  [<»,,,,„, is  an  unknown  parameter 

representing  uncertain  command  efficiency  and  are  known  bounds,  such  that  0  <  ru,  <  ; 

f(t,x(ty)  MxM"  ^  M  is  an  unknown,  nonlinear,  continuous  mapping;  Xq  g  M  is  the  state 
initial  condition,  known  to  be  in  an  arbitrarily  large,  but  bounded  set;  and  y{t)  e  R  is  the 
system  output  [25]. 

3,  State  Predictor 

The  state  predictor  builds  off  of  the  basic  plant  architecture  and  represents  the 
estimated  states; 


44 


x(0)  =  Xo 


(33) 


X  =  A^x(t)  +  B{d){t)u{t)  +  e\\ x(t)  IL  +(7(0) 
y  =  C^x(0  I 

where  d)(t),0(t),and(j(t)  e  R  are  the  adaptive  parameter  estimates  [25].  Here  the  infinity 
norm  of  the  state  variable,  ||x(t)||^  is  a  suitable  substitute  for  the  nonlinear  term, 
x(0  I  x(0  I ,  as  shown  in  Section  2.4  in  [25]. 


4.  Control  Law 


The  £i  AC  system  composes  its  control  signal  according  to  the  following  Laplace 
domain  Equation  [25]; 


u(s)  =  -kD(s)(ju(s)  -  k^r(s)) 

/j(s)  -  {//}  =£f{  d)(t)u  (t)  + 6  \  \  x(t)  1 1^  +d'(t) } 


(34) 


where  D(s)  is  a  strictly  proper  transfer  function  acting  as  a  low  pass  filter,  and  k  is  the 
feedback  gain;  the  selection  criteria  for  D(s)  and  k  are  discussed  further  in  Section  6. 

-1 


The  command  signal  gain,  k^  = 


c^aOb 


satisfies  zero  steady  state  tracking  error  for  a 


step  response. 


5.  Adaptation  Law 

The  control  law  above  is  written  in  terms  of  the  estimated  parameters.  Calculation 
of  the  adaptive  parameter  estimates  is  accomplished  according  to  the  laws  shown  in 
Equation  (35).  The  Projection  Operator  in  the  adaptation  law  ensures  that  the  adaptive 

parameter  estimates  remain  bounded,  such  that  ft>(t)eQ,  \9(t)\<9^^  and  |(T(t) |<cr^^ . 
This  is  required  for  the  stability  proof  to  remain  valid. 

^(0  =  r,Proj(^(0, -x\t)\\x(0\lPB)  m  =  9, 

a(0  =  r.Proj(rT(0,  -x-^iOPB)  9(0)  =  9,  (35) 

a>  =  r^Proj(®(0»  -x^ (0u(0PB)  a>(0)  = 

where,  E  e  is  the  adaptation  gain.  State  error,  x(0 ,  is  defined  by 
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x(0  =  x(0-x(0 


(36) 


and  P=F^  >0  is  the  solution  to  the  Lyapunov  equation,  a^p  +  pa^  =-Q,  with  aibitraiy, 
synunetiic  Q  =  Q’^  >o  [25], 

The  proceeding  calculations  are  now  summarized  in  Table  4. 


Open-loop  Plant 

X  =  A„x+Bicou(t)+fit,x(,t)))  .r(0)  =  .Xq 
y  =  C^x(t) 

State  Predictor 

X  =  A„x(t)  +  B{co{t)ti{t)  +  (9 II  x(0  IL  +<t(0) 
y  =  CLx(0  1 

.x(0)  =  .Xo 

Tracking  Error 

.x(0  =  .i(t)-.x(0 

Control  Signal 

u{s)  =  -kD{sms)-k,ris)) 

=£f{co{t)u{t)  yew  x{t)  IL 

+<j(t)} 

m  =  r,Proj(0(O, -x\t)  II  .r(0  IL  PB) 

^(0)  =  4 

Adaptation  Laws 

a-(O)  =  0^0 

CO  =  r^Proj(<y(/'),  -  f  {t)ti{t)PB) 

II 

o' 

Table  4.  £i  AC  Design  Summary,  after  [1 1] 


B.  APPLICATION:  THAIIS  HEAVE  MODE 


The  parametric  model  fiorn  Eqiration  (12)  is  rewritten  in  the  form  of  the  £i  AC 
plant  architectme  from  Eqiration  (32); 


n’  =  - 


I  I  + - — (Z  +  irj)) 

m  -Z^  ^ 


(37) 


where,  the  linear  damping  term,  Z^=0  is  introduced  to  conesporid  to  which  has 

been  empuically  evaluated  to  be  [-0.4]  in  order  to  express  the  actiral  (rneasmed)  plant 
response.  The  state  variable  x(t)  conesponds  to  the  z-diiection  velocity,  w.  System  input 

ii{t)  conesponds  to  the  actirator  force,  Z  .  It  is  conveniently  assirmed  that  B= — ^ — , 

ni-Z^ 

also  C=1  for  the  smgle  input,  single  output  system  (SISO).  The  unknown  constant,  a  , 

represents  the  actuator  effectiveness,  an  imcerlain  system  input  gain.  The  remaining 
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terms  from  the  parametric  model  can  be  associated  with  the  unknown  function,  / {t,x{t)) 


f{t,x{t))  =  — AJw(t)  +  —^w(t)  I  w{t)  I  + — ^g,(?7)  (38) 

m-  m-  Z^  m-  Z^ 

Combining  and  rewriting  these  terms  in  the  form  of  Equation  (32)  results  in  the 
plant  dynamics  expression 

1  ^  ^11  1 

w{t)  =  A  w{t)  +  B{ - —u{t)  +  { A  )w{t)+  ^''^'w{t)\w{t)\+ - — g,(/7)),  w(0)  =  w  (39) 

m  m-Z  m-Z  m  m-Z  m-Z  U 

w  w  w  w 

y{t)  =  w{t) 

which  simplifies  to  the  original  parametric  model  for  the  THAUS  from  Equation  (12). 

Similar  to  the  plant,  the  predictor  term  =  [-0.4]  is  chosen  to  give  the  desired 
plant  response,  B  =  [ — ^ — ]  is  assumed,  C  =  [1]  and  y(t)  =  x(t)  for  a  SISO  system.  The 

term,  1 1  x(f)  ||^,  is  the  infinity  norm  of  the  states  and  corresponds  to  ||  w(0ILH  ^01  for 
the  SISO  system  and  replaces  the  nonlinear  term.  The  remaining  terms  in  the  predictor  do 
not  correlate  directly  with  terms  in  the  parametric  model  and  are  adjusted  by  the  adaptive 
and  control  laws.  The  predictor  equation  can  now  be  rewritten  as; 

w{t)  =  A^w(t)  +  B((v(t)u(t)  +  0(t)\w(t)\+a(t))  w(0)  =  Wq 

y(t)  =  w{t) 

No  significant  changes  to  the  adaptation  or  control  laws,  other  than  substituting 
the  correct  states,  were  required.  The  adaptation  gain  applied  was  F  =  5e7 .  The 
Projection  Operator  bounds  are  =400, =200,  and  =0.85,  with  a 

parameter  Projection  Operator  centered  at  1.15.  The  initial  conditions  for  the  controller 

parameters  are  all  zero.  The  control  signal  filter  is  D{s)  =  — ,  and  the  feedback  gain, 

s 

k  =  6 .  Eurthermore,  in  order  to  better  mimic  the  behavior  of  the  real  THAEIS,  a 
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saturation  limitation  is  placed  on  the  output  of  the  control  signal,  restricting  the  control 
effort  to  ±85  Newtons. 

C.  SIMULATION 

The  L\  AC  system  was  evaluated  in  simulation  using  MATLAB  and  Simulink, 
without  implementation  on  the  THAUS.  After  the  development  of  the  L\  AC  algorithm 
and  application  to  the  system  model  a  Simulink  model  was  created  to  represent  the 
closed-loop  eontroller-plant  system,  shown  in  Figure  20.  Detailed  simulations  models  and 
assoeiated  eode  are  available  in  Appendix  B. 


Figure  20.  L\  AC  Simulink  Model 


1,  Xi  AC:  Sinusoidal  Command 

The  first  simulation  evaluates  the  L\  AC  system’s  response  to  the  sinusoidal 

1  TT 

command,  r(t)  =  — sin(0.1t  +  y) .  The  simulation  results  in  Figure  21.  show  a  plant 

response  the  follows  the  state  predietor  extremely  elosely,  without  signifieant  error.  The 
deviation  from  the  eommand  signal  is,  similar  to  MRAC,  primarily  a  result  of  the 
predietor  model’s  limitations  in  its  ability  to  respond  to  and  follow  the  eommand  signal. 
Comparison  to  the  ideal  output  confirms  this. 
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Figure  21 .  Li  AC:  Sinusoidal  Command  System  Response 


The  error  data  (Figure  22.  )  reveals  some  small  oscillations  of  the  plant  response 
about  the  predictor’s  response;  however,  this  error  is  much  smaller  than  TFIAUS’  sensors 
are  cable  of  measuring  and  is  considered  insignificant. 


Figure  22.  L\  AC:  Sinusoidal  Command  Error 
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Although  controller  parameters  in  Figure  23.  do  not  eonverge  to  a  steady  state 
solution  within  the  simulation  time  frame  they  do  appear  to  oscillate,  with  plateaus,  about 
solution  value;  this  boundedness  permits  steady  state  error  to  go  to  zero.  The  various 
values  for  the  controller  parameters  each  satisfy  the  adaptation  solution,  achieving  very 
small  tracking  error. 


Figure  23.  L\  AC:  Sinusoidal  Command  Controller  Parameters 

The  control  signal  in  Figure  24.  remains  smooth  and  bounded  throughout  the 
simulation.  The  control  effort  required  by  the  system  is  achievable. 
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Control  Signal 


Figure  24.  L\  AC:  Sinusoidal  Command  Control  Signal 


This  simulation  demonstrates  the  successful  response  of  the  L\  AC  system  when 
applied  to  a  system  with  limited  a  priori  knowledge  of  the  plant’s  dynamic  parameters. 

2.  Xi  AC:  Time-Varying  Parameters 

The  second  simulation  evaluates  the  L\  AC  system’s  ability  to  respond  to  a  step 
response  with  r  =  0.5  m/s,  and  time -varying  parameters  based  on  the  addition  of  a  0.02 
kg  mass  at  t  =  15  s.  The  system  responds  well  both  to  the  step  command  as  well  as  the 
mass  change,  shown  in  Figure  25.  Because  the  controller  responds  quickly  the  effect  of 
the  configuration  change  is  relatively  small.  In  comparison  with  the  MRAC  system,  the 
transient  response  is  much  more  stable,  while  also  very  quick  to  respond  and  reach  steady 
state.  Additionally,  while  the  MRAC  reference  model  does  not  respond  to  the  change  in 
parameters  (as  discussed  in  Chapter  III)  the  predictor  system  does.  This  response  is  due 
to  the  differing  structure  of  the  L\  adaptive  controller.  The  control  signal,  u{t),  a  function 
of  the  parameter  estimates,  enters  both  the  predictor  as  well  as  the  plant.  A  change  in 
actual  parameters  results  in  a  change  in  their  estimates  and  thus  a  change  in  predictor 
behavior. 
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Figure  25.  L\  AC:  Time-Varying  Parameters  System  Response 

Figure  26.  shows  the  error  to  be  very  small  with  only  slight  divergences  from 
state  predictor’s  response.  The  only  significant  error  is  that  induced  by  the  sudden 
parameter  change,  though  this  is  quickly  corrected  by  the  controller. 


6 

5 

4 

3 

i  2)- 

> 

i  1 
0 

-1 

-2 


x10*^ 


Error  v  Time 


10  15 

Time  [s] 


20 


25 


30 


Figure  26.  L\  AC:  Time-Varying  Parameters  Error 
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In  Figure  27.  the  controller  parameters  quickly  converge  to  steady  state  solutions. 
Once  the  mass  change  is  implemented  the  parameters  adjust  and  quickly  converge  to  new 
state  solutions.  Figure  28.  shows  the  dynamic  parameters  themselves  changing. 


Figure  27.  L\  AC:  Time -Varying  Parameters  Controller  Parameters 
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Figure  28,  £i  AC:  Time-Varying  Parameters 


The  eontrol  signal,  shown  in  Figure  29,  ,  applied  throughout  simulation  is 
bounded,  maintaining  an  achievable  control  effort.  After  the  mass  is  increased,  the 
system  responds  quickly  and  settles  at  a  new  steady  state  control  value.  Some  very  small 
amplitude,  undesirable,  high  frequency  content  was  observed  in  the  control  signal; 
however,  this  never  translated  into  high  frequency  responses  by  the  plant  or  state 
predictor.  More  careful  selection  of  the  control  signal  filter  could  potentially  eliminate 
this  behavior. 
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Figure  29.  L\  AC:  Time-Varying  Parameters  Control  Signal 


The  L\  AC  system  simulation  with  time-varying  parameters  successfully 
demonstrated  the  control  system’s  ability  to  respond  to  step  command  signals  as  well  as  a 
plant  configuration  change.  The  high  gains  employed  in  this  controller  enabled  the 
system  to  track  the  state  predictor  quickly  and  accurately,  using  an  achievable  control 
effort.  In  comparison  to  MRAC,  transient  responses  were  much  quicker,  with  fewer 
oscillations  and  faster  settling  times. 


55 


THIS  PAGE  INTENTIONALLY  LEET  BLANK 


56 


V.  EXPERIMENTAL  RESULTS 


A,  IMPLEMENTATION 

Testing  the  developed  algorithms  on  the  THAUS  platform  requires  integration 
with  the  command  software  used  for  the  autonomous  operation  of  the  platform.  This 
infrastructure  has  been  developed  as  part  of  the  RDAS  research  program.  The  Robotic 
Operating  System  (ROS)  is  used  for  this  purpose.  ROS  is  foremost  a  development  and 
deployment  architecture  that  provides  a  messaging  protocol  to  communicate  information 
between  processes.  Since  ROS  uses  a  TCP/IP  protocol,  these  processes  can  be  distributed 
across  multiple  machines  on  a  network.  ROS  additionally  provides  tools  for  the 
development  and  execution  of  these  systems,  which  consist  of  multiple  processes.  This 
architecture  allows  for  the  development  of  highly  modular  code  to  realize  a  complex 
robotic  system.  Researchers  at  CAVR  have  implemented  such  architecture  (Figure  30.  ) 
on  the  THAUS.  One  of  the  benefits  of  this  modular  implementation  is  the  ability  to  apply 
the  same  tools  on  multiple  platforms,  including  the  REMUS  AUV,  SeaFox  USV,  and  the 
ScanEagle  UAV. 
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Figure  30.  ROS  Software  Architecture 


One  prohibitive  factor  with  ROS  is  the  requirement  to  develop  in  either  the  C++ 
or  Python  programming  languages,  which  significantly  increases  the  learning  curve  to  be 
able  to  implement  advanced  control  algorithms  as  part  of  student  research.  Instead,  one 
convenient  tool  that  is  routinely  used  at  NPS  for  control  algorithm  development  is 
MATLAB  Simulink.  This  provides  a  useful  graphical  interface  for  designing  and 
implementing  algorithms.  In  parallel  to  the  efforts  of  this  research,  CAVR  personnel  have 
developed  an  approach  to  directly  integrate  the  algorithms  developed  in  Simulink  into  the 
ROS  architecture.  The  Simulink  model  for  the  ROS  interface  is  shown  in  Figure  31.  This 
approach  utilizes  the  automatic  code  generation  functionality  of  Simulink  to  build  a  C++ 
library  containing  the  algorithm.  This  library  is  then  integrated  into  a  process  (ROS  node) 
that  provides  the  control  algorithm  with  the  necessary  information  (i.e.,  measurements, 
reference  signals,  and  controller  gains).  This  node,  implemented  in  C++,  initializes  the 
control  algorithm  and  schedules  its  execution. 
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Figure  3 1 .  ROS  Interface  Simulink  Model 


Data  exchange  is  defined  through  the  use  of  buses  in  Simulink.  In  the 
implementation  above,  three  input  buses  were  defined;  odometry  (measured  vehicle 
states),  reference  signal,  constants  (for  controller  tuning).  Two  output  buses  include  the 
control  signal  and  generic  debug  information.  Initial  conditions  and  other  control 
algorithm  parameters  can  be  set  from  within  the  ROS  process  as  well. 

The  automatic  code  generation  functionality  was  developed  to  support  real-time 
execution  of  control  processes.  However,  most  stock  operating  systems  do  not  support 
hard  real-time  execution  by  default.  This  limitation  has  become  less  severe  as  operating 
systems  have  improved  and  processor  speeds  have  increased.  For  Linux,  these  algorithms 
can  be  mn  in  soft  real-time,  which  most  often  proves  sufficient.  The  current 
implementation  of  this  ROS-Simulink  integration  does  not  provide  hard  real-time 
execution.  This  will  be  investigated  in  the  future  if  the  need  arises. 

Soft  real-time  execution  requires  careful  consideration  of  the  sampling  times  used 
when  developing  the  control  algorithm.  For  this  research,  the  system  amounts  to  two 
loops  that  run  at  different  rates.  For  the  adaptation  process,  there  is  a  need  to  increase  the 
execution  rate  as  much  as  possible  to  allow  for  fast  adaptation.  However,  this  process 
must  interface  with  a  real  platform  that  can  only  execute  commands  at  a  specified  (lower) 
rate,  and  for  which  measurements  can  only  be  obtained  at  a  much  slower  rate. 
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Furthermore,  the  real  system  will  have  delays  due  to  communications,  computation, 
actuator  dynamics,  etc.  These  differences  between  the  simulated  system  and  the  real 
system  must  be  accounted  for  as  much  as  possible  and  is  investigated  in  Section  B.l. 

For  this  implementation,  a  fixed-step  numerical  integration  scheme  (the  ode3 
algorithm)  was  used.  This  time  step  was  set  to  0.01  s  sampling  time.  This  sampling  time 
is  limited  by  the  amount  of  computation  required  to  calculate  the  adaptation  and  control 
signal  for  the  high-rate  loop.  This  sampling  rate  was  verified  to  be  sufficient,  but  was  not 
optimized.  This  task  will  be  undertaken  in  future  work.  The  ROS  node  schedules  the 
inner-loop  control  algorithm  and  communicates  the  control  signal  to  the  vehicle  at  the 
appropriate  times. 

B,  EXPERIMENTAL  RESULTS 

1.  MRAC:  Time-Varying  Parameters  Simulation  with  Rate  Transitions 

An  additional  step  was  taken  in  the  MRAC  simulation  model  that  added  rate 
transitions  of  signals  between  the  plant,  reference  model  and  controller  blocks.  The  rate 
transitions  were  added  in  order  to  better  simulate  the  actual  processing  ability  of  the 
THAUS.  The  system  is  able  to  send  commands  at  10  Hz,  and  can  receive  data  at  12  Hz. 
In  this  simulation,  the  gains  were  =le5,  F^  =le5,andF^  =le5 .  No  other  conditions 

were  changed.  Figure  32.  shows  the  response  of  the  system  to  a  step  response  with  time- 
varying  parameters,  but  without  rate  transitions.  In  contrast.  Figure  33.  shows  the  system 
response  after  rate  transitions  have  been  added  (to  better  represent  the  actual  plant).  The 
response  with  rate  transitions  is  more  oscillatory  due  to  more  aggressive  corrective 
behavior  that  occurs  as  a  result  of  the  slower  signal  rates.  The  oscillations  present  in  the 
system  response  are  consistent  in  the  error,  parameter  convergence,  and  error  data  as 
well.  This  behavior  can  be  minimized,  though,  by  tuning  the  system  in  such  a  way  that 
limits  the  aggressive  corrections.  The  reduced  gains  used  in  the  final  MRAC  simulations 
(Figure  34.  ),  F^  =  6e4,  F^  =  2e4 ,  and  Fg=2e4,  were  selected  for  this  purpose. 

Applying  rate  transitions  to  simulations  using  the  reduced  gains  produced  a  system 

response  very  similar  to  those  with  continuous  signal  rates.  For  this  reason,  these  gains 

were  employed  in  the  experimental  implementation  discussed  in  Sections  2  through  4. 
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Figure  32.  MRAC:  Time- Varying  Parameters,  No  Rate  Transitions  and  Original 

Gains 


Figure  33.  MRAC:  Time- Varying  Parameters,  Rate  Transitions  and  Original 

Gains 


61 


0.7 


System  Response 


Figure  34.  MRAC:  Time -Varying  Parameters,  Rate  Transitions  and  Tuned 

Gains 

2,  MRAC  Depth  Step  Command 

The  physical  experimentation  phase  of  research  began  with  the  MRAC  system 
implemented  on  board  the  vLBVSOO  THAUS  via  the  ROS  interface  as  discussed 
in  Section  A.  The  experiments  took  place  in  a  small  tank  of  fresh  water,  approximately 
1.5  m  deep.  First,  the  vehicle  was  given  a  depth  step  command,  moving  from  z  =  0.1  m 
to  z  =  0.4  m  depth.  This  position  command  was  translated  into  a  rate  command  by  the 
proportional  relationship,  "^command  error  ■  The  gains  used  to  implement  the 

controller  were  the  same  as  those  developed  in  simulation,  =  6e4,  =  2e4 ,  and 
Yg  =  2eA.  The  system  response  is  shown  in  Figure  35.  .  As  expected,  oscillations  are 

present  in  both  the  command  velocity  and  the  plant  velocity.  While  the  plant  was  tuned  to 
maximize  robustness,  not  all  oscillatory  behavior  could  be  eliminated.  Additionally,  noise 
and  sensor  accuracy  contribute  to  the  oscillatory  behavior.  Nevertheless,  as  a  whole,  the 
system  responds  stably  to  the  depth  step  command. 
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Figure  35.  MRAC:  Depth  Step  Command 


Although  the  error  value  in  Figure  36.  does  not  converge,  it  does  remain 
conservatively  within  the  reasonable  limits  of  measurement  noise.  This  assertion  is 
supported  by  the  similarly  small  magnitude  of  command  signals.  For  comparison, 
average  velocity  error  is  0.0106  m/s,  INS  velocity  accuracy  is  0.001  m/s  and  DVL 
velocity  accuracy  is  0.2  m/s.  Based  on  this  analysis,  the  error  is  practically  assumed  to 
converge  to  zero. 
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Figure  36.  MRAC:  Depth  Step  Command  Error 


The  step  eommand  has  no  effect  on  the  controller  parameters.  The  parameters 
were  allowed  to  reach  steady  state  solutions  prior  to  the  step  command  and,  as  is  evident 
in  Figure  37.  remain  constant  during  the  system  response.  This  behavior  correlates  to  a 
constant  system  configuration. 
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Figure  37.  MRAC:  Depth  Command  Error  Controller  Parameters 
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The  control  signal  (Figure  38.  )  passed  to  the  THAUS  remains  well  bounded  and 
achievable.  Undesirable  oscillations  persist  as  a  product  of  position  error,  sensor 
accuracy,  and  noise. 
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Figure  38.  MRAC:  Depth  Step  Command  Control  Signal 

3.  MRAC  Weight  Added 

In  order  to  evaluate  the  MRAC  performance  for  a  configuration  change,  a  0.5  kg 
weight  was  added  to  the  vehicle  while  depth  command  was  z  =  0.1  m.  All  other 
parameters  remained  the  same  as  in  the  previous  experiment.  Flere,  in  Figure  39.  ,  the 
system  response  to  the  plant  configuration  change  is  evaluated.  Velocity  initially 
increases  as  the  extra  weight  begins  to  sink  the  vehicle.  Adaptive  corrections  are  then 
quickly  made  and  the  vehicle  compensates  for  the  extra  weights,  returns  to  its  ordered 
depth,  and  velocity  converges  to  zero. 
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Figure  39.  MRAC:  Weight  Added  System  Response 


The  system  error  in  Figure  40.  ehanges  quiekly  when  the  weight  is  added  and  the 
vehiele  sinks,  reeovers  and  inereases  in  the  opposite  direction,  but  then  settles  near  zero 
as  expected. 
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Figure  40.  MRAC:  Weight  Added  Error 
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The  majority  of  the  system’s  controller  parameters,  shown  in  Figure  41.  ,  are 
unchanged  since  plant  dynamics  relating  to  dampening  are  unaffected  by  the  added 
weight.  The  6^  parameter,  which  corresponds  to  the  restoring  forces,  gj^rf)  ,  does  change 
though,  to  compensate  for  the  deviation  from  neutral  buoyancy. 
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Figure  41 .  MRAC:  Weight  Added  Controller  Parameters 


Control  effort  remains  bounded  as  the  system  adapts  and  the  control  signal 
converges  to  a  new  steady  state  value.  Inspection  of  the  data  in  Figure  42.  shows  that  the 
vehicle  changed  from  a  slightly  positive  buoyance  to  negative  buoyancy. 
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Figure  42.  MRAC:  Weight  Added  Control  Effort 


4,  MRAC  Weight  Removed 

The  eonfiguration  ehange  experiment  was  repeated  in  reverse,  this  time  removing 
the  0.5  kg  weight.  The  vehiele  and  eontroller  parameters  remained  eonstant  in  all  other 
regards.  All  of  the  results  observed  exhibited  the  expeeted  behavior.  The  vehiele 
aeeelerated  toward  the  surfaee  after  the  weight  was  removed  but  quiekly  slowed  its  assent 
and  returned  to  its  ordered  position.  System  response  is  shown  in  Figure  43. 
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Figure  43.  MRAC:  Weight  Removed  System  Response 

The  error  (Figure  44.  )  correspondingly  increase  immediately  after  the  weight  is 
removed  but  then  quickly  begins  converging  back  to  zero  as  parameter  adaptation  takes 
place. 


Figure  44.  MRAC:  Weight  Removed  Error 
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In  Figure  45.  parameter  adaptation  of  can  be  clearly  seen.  After  the  weight  is 

removed  the  value  trends  back  to  the  original  steady  state  value  near  zero,  corresponding 
to  the  near  neutral  buoyancy  condition. 


Controller  Parameters 


■ 

— fl, 

- 0.. 

- K.  ■ 

- AV 

■ 

■ 

0  5  10  16  20  25  30 

Time  [s] 

Figure  45.  MRAC:  Weight  Removed  Controller  Parameters 

The  control  effort,  in  Figure  46.  ,  after  the  weight  is  removed  settles  at  the 
previous,  steady  state  level  for  the  vehicle  configuration  with  slightly  positive  buoyancy. 
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Figure  46.  MRAC:  Weight  Removed  Control  Effort 
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VI.  CONCLUSIONS 


A,  SUMMARY 

The  proposed  Robotie  Diver’s  Assistant  System  would  augment  a  dive  team  in 
their  underwater  operations  to  enhanee  safety,  effieieney  and  eapabilities  of  joint  robot- 
human  missions  in  arduous  environments.  A  RDAS  requires  a  robust,  quiekly  adaptable 
eontrol  system  to  enable  a  THAUS  to  operate  aeeurately  and  stably  in  dynamie 
environments,  in  elose  quarters  with  human  divers,  and  in  a  variety  of  eonfigurations  that 
may  ehange  mid-mission. 

The  proposed  platform  for  the  RDAS  is  the  vLBV300  THAUS.  Beeause  this 
AUV  is  operated  within  4-DOFs  the  vehiele  ean  be  preeisely  eontrolled  and  is  a  prudent 
eandidate  for  the  RDAS.  Building  on  previous  researeh  the  THAUS  was  modeled  using 
experimentally  derived  veloeity  step  response  data.  The  parametrie  dynamie  model 
derived  for  this  system  was  written  in  terms  of  a  regressor.  The  Linear  Least  Squares 
SysID  method  was  applied  to  the  system  in  order  to  identify  a  nominal  parametrie 
dynamie  model  for  use  in  development  of  an  adaptive  eontrol  system.  The  two  eandidate 
eontrol  systems  were  Model  Referenee  Adaptive  Control  and  L\  Adaptive  Control. 

The  MRAC  system  proved  to  be  very  eapable  in  simulation.  The  adaptive 
arehiteeture  enabled  the  system  to  adapt  the  eontroller  parameters  in  the  presenee  of 
unmodeled,  inaeeurately  modeled,  and  time  variant  parameters.  Simulation  experiments 
demonstrated  that  the  adaptive  system  enabled  the  THAUS  to  eonsistently  traek  a 
eonstantly  ehanging  veloeity  as  well  as  maintain  a  eonstant  veloeity,  both  with  small 
steady  state  errors.  The  system  was  eapable  of  eonverging  to  stable  eontroller  parameter 
solutions  without  aeeurate  initial  eonditions  of  those  parameters.  This  resulted  in 
sueeessful  traeking  that  was  aehieved  without  a  priori  knowledge  of  the  plant’s  dynamie 
parameters  or  the  eontroller  parameters.  Traeking  performanee  proved  to  be  very  aeeurate 
over  time;  however,  eoupling  prevented  the  system  from  both  performing  robustly  and 
adapting  quiekly.  Adaptation  gains  had  to  be  seleeted  sueh  that  robustness  was  not 
exeessively  diminished  in  order  to  aehieve  fast  adaptation. 
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This  limitation  motivated  the  addition  of  modifications  to  increase  the  robustness 
in  the  system  while  still  enabling  fast  adaptation.  The  dead  zone  modification  disabled 
the  adaptation  process  when  the  state  error  was  sufficiently  low.  This  prevented  the 
adaptation  law  unnecessarily  searching  for  controller  parameter  solutions  once  a  “good 
enough”  solution  had  been  found.  The  dead  zone  modification  reduced  oscillation  and 
drift  in  controller  parameters,  enabling  more  stable  system  tracking.  The  Projection 
Operator  modification  bounded  the  controller  parameters  within  selected  limits 
preventing  so  called  parameter  “wind-up,”  a  more  severe  form  of  parameter  drift.  The 
Projection  Operator  would  redirect  the  solution  vector  for  a  controller  parameter  if  the 
algorithm  determined  that  parameter  lay  outside  of  the  projection  boundaries  or  within 
the  projection  tolerance.  The  Projection  Operator  modification  prevented  controller 
parameter  solutions  with  excessively  high  values  and  the  resulting  system  becoming 
unstable.  Enforcing  parameter  bounds  reduced  the  occurrence  of  oscillatory  behavior 
both  in  frequency  and  amplitude.  Additionally,  the  control  efforts  required  to  track  the 
reference  system  were  reduced.  In  combination  these  two  modifiers  allowed  the  system 
to  accept  high  adaptation  gains  required  for  fast  adaptation,  while  maintaining  robustness, 
producing  good  steady  state  performance  in  both  transients  and  steady  state. 

In  preparation  for  implementing  the  MRAC  system  onto  the  THAUS,  the  effects 
of  data  transfer  rate  transitions  on  system  performance  was  investigated.  Asynchronous 
transition  functions  were  introduced  into  the  MRAC  Simulink  model  to  simulate  the 
different  data  rates  provided  by  the  controller  and  the  vehicle  sensors.  The  rate  transitions 
limited  the  control  system’s  ability  to  quickly  respond  to  incremental  changes,  because 
slower,  asynchronous  data  transfer  prevented  the  system  from  recognizing  those  changes 
had  occurred.  Then,  the  system  could  not  quickly  send  the  updated  control  signal  based 
on  those  changes.  As  a  result  the  robustness  and  steady  state  tracking  ability  of  the 
system  suffered,  necessitating  a  reduction  in  adaptation  gains 

Implementation  of  the  MRAC  system  onto  the  vLVBSOO  THAUS  for  physical 
experiments  was  accomplished  via  introduction  of  a  ROS  based  interface.  The  controller 
was  first  evaluated  in  response  to  step  commands  with  successful  performance.  The 
system  proved  capable  of  accurately  tracking  the  reference  model  despite  the  lack  of  a 
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priori  knowledge  of  plant  dynamies.  The  controller  was  also  evaluated  in  response  to 
plant  parameter  variation  by  changing  the  mass  of  the  vehicle.  The  control  system 
performed  successfully  in  this  task  as  well.  The  change  in  the  plant  configuration  was 
quickly  recognized  and  the  adaptation  law  adjusted  the  controller  parameters  as  required 
to  compensate  for  this  change,  enabling  the  system  to  maintain  accurate  steady  state 
tracking.  Overall,  the  MRAC  system  proved  to  be  both  capable  and  practical;  however, 
the  limitations  of  the  system  with  regard  to  adaptation  speed  and  robustness  persisted. 
The  transient  response  of  the  system  was  particularly  less  stable  than  desired.  This 
limitation  became  especially  apparent  in  physical  implementation,  even  with  the  use  of 
the  modifiers.  An  MRAC  system  is  a  great  candidate  for  an  RDAS  but  must  be 
meticulously  tuned  to  meet  performance  expectations. 

fn  light  of  the  limitations  in  MRAC,  an  alternative  adaptive  control  solution  was 
evaluated;  XiAC.  This  control  system  decouples  robust  performance  from  fast  adaptation. 
XiAC  accomplishes  decoupling  by  implementing  a  low  pass  filter  on  the  control  signal 
input  to  the  state  predictor  and  plant.  This  filter  eliminates  high  frequency  content 
associated  with  selection  of  high  adaptation  gains.  High  frequency  content  in  the  control 
signal  can  contribute  to  a  loss  of  robustness  evidenced  by  oscillations,  overshoot  and 
overly  aggressive  corrections  in  the  system  response.  In  addition  to  the  filter,  robustness 
is  aided  by  the  use  of  the  Projection  Operator  in  the  adaptation  law.  As  in  MRAC,  the 
Projection  Operator  bounds  the  controller  parameters  according  to  selected  limits.  These 
key  features  of  XiAC  enable  it  to  perform  exceptionally  well  with  regard  to  both 
robustness  and  adaptation  speed.  Indeed,  for  a  properly  formulated  problem  stability  and 
parameter  convergence  can  be  guaranteed. 

The  simulated  system  responded  extremely  well  to  the  sinusoidal  velocity 
command  in  simulation.  The  plant  began  tracking  with  the  state  predictor  almost 
immediately.  Error  remained  very  low  through  the  simulation,  and  control  effort  was 
limited  to  within  achievable  bounds.  Additionally,  controller  parameters  converged 
around  steady  state  values.  A  similarly  well  performing  response  was  observed  in  the 
simulation  with  time -varying  parameters  and  a  step  input  command.  System  response  to 
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the  step  eommand  was  fast  and  smooth,  with  very  little  error  between  the  state  predictor 
and  the  plant,  both  of  which  performed  similar  to  the  ideal  plant  model  representing  the 
desired  response.  Adaptation  parameters  converged  quickly  and  responded  very  quickly 
to  the  change  in  plant  parameters  caused  by  increasing  the  system  mass.  Again,  the 
control  effort  was  well  bounded  to  within  achievable  values. 

The  results  were  not  without  imperfections,  though.  High  frequency  oscillations 
of  small  amplitude  were  observed  in  the  control  signal.  This  high  frequency  content  did 
remain  stable,  however,  and  did  not  cause  oscillations  or  unstable  behavior  in  the  plant 
and  state  predictor  response.  This  behavior  emphasizes  the  importance  of  selecting  an 
appropriate  control  signal  filter.  The  filter  selected  must  be  meticulously  selected  to 
ensure  that  high  frequency  content  is  eliminated  and  the  system  response  is  not  affected. 
Overall  the  system  performed  extremely  well  is  should  be  considered  as  a  candidate  for 
further  implementation  on  the  physical  platform. 

B,  FUTURE  WORK 

The  development  of  the  RDAS  using  the  vLBVSOO  is  an  ongoing  research  effort 
by  CAVR.  Further  research  in  the  field  of  adaptive  control  systems  will  continue  to 
benefit  the  project  and  will  support  the  vehicle’s  envisioned  mission. 

More  advanced  modeling  of  the  vLBVSOO  is  in  progress.  The  advanced  methods 
being  used  to  model  the  vehicle  will  create  a  more  accurate,  coupled  dynamic  model. 
This  model  will  aid  in  simulation,  control  system  design,  and  evaluation. 

With  regard  to  the  development  of  the  adaptive  controllers,  continued  careful 
tuning  of  control  and  adaptation  parameters  is  required  to  ensure  the  controller  is 
operated  optimally.  MRAC  could  also  benefit  from  research  into  additional  modifications 
that  could  enhance  robustness.  XiAC  requires  more  careful  attention  to  the  control  signal 
filter  in  order  to  eliminate  high  frequency  content. 

Continued  experimental  evaluation  of  the  MRAC  is  recommended.  Additionally, 
XiAC  should  be  implemented  onboard  the  THAUS  as  MRAC  was.  Evaluating  these  two 
control  architectures  in  parallel  will  ensure  the  selection  of  the  control  system  candidate 
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best  suited  for  the  mission  of  a  RDAS.  In  this  vein,  more  quantitative  (viee  qualitative) 
analysis  teehniques  should  be  employed  to  support  selection  of  control  system 
architecture  and  associated  parameters. 

To  further  support  the  choice  of  the  controller  and  its  parameters,  more 
experimental  research  should  be  conducted  in  the  environment  the  system  is  anticipated 
to  operate  in  (i.e.,  ocean  conditions  with  currents,  waves,  etc.).  Exposure  to  external 
disturbances  and  other  unknowns  are  an  excellent  way  to  prove  the  capabilities  of  the 
control  systems.  Finally,  the  techniques  and  procedures  exhaustively  perfected  in  regard 
to  the  heave  channel  will  be  replicated  for  the  other  degrees  of  freedom,  producing  a 
more  comprehensive,  multi-input  multi-output  adaptive  control  system  that  can  robustly 
stabilize  the  coupled  dynamical  system. 
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APPENDIX  A.  MRAC  CODE  AND  SIMULATION  DIAGRAM 


A.  MATLAB  CODE 

%%  MRAC  with  Time-Varying  Parameters 
%  LT  Nicholas  Valladarez 
%  Naval  Postgraduate  School 
%  December  2014 


clear  all;  close  all;  %clc; 

%%  System  Parameters 

%  Dynamic  Properties 
ml  =  33;  m2  =  ml  +  .02;  %  Mass  [kg] 
buoy  =  ml*9.81;  %  Buoyancy  [N] 

mg  =  [ml*9.81  m2*9.81];  %  Weight  [N] 
Z_dw  =  -244.3629; 

Z  ww  =  -128.8485; 

a 1  =  [0  0  ]  ; 

a2  =  [Z  ww/ (ml-Z  dw)  Z  ww/ (m2-Z  dw) ] ; 
a3  =  [1/ (ml-Z  dw)  1/ (m2-Z  dw) ] ; 

%  Reformating  Model 
A  =  [al  (1)  ]  ;  B  =  [a3  (1)  ]  ;  C  =  [1]  ; 

Am  =  [-0.4]; 

kg  =  -1/ (C' /Am*B) ; 

Bm  =  B  *  kg ; 

%  Controller  Parameters 
P  =  lyap (Am' , eye ( 1 ) ) ; 


PB=P*B; 
delta  = 
Epsilon 

0.001; 

=  0.3; 

%  Dead  zone 
%  Projection 

Tolerance 

Gamma  x 
Bound  / 

=  1  e  5 ; 

IC 

Pr  X  =  100; 

y; 

X 

1 

o 

II 

o 

%  Gain 

/ 

Pro  j 

Gamma  r 
Bound  / 

=  le5; 

IC 

Pr  r  =  200; 

o 

II 

o 

1 

%  Gain 

/ 

Proj 

Gamma  theta  =  le5; 
Bound  /  IC 

Pr  t  =  50; 

Theta  0=0; 

%  Gain 

/ 

Pro  j 

%%  Simulation 


%  Simulation 
xmO  =  0 ; 
xO  =  0; 
r  =  .  5  ; 

TIME  =  100; 
TRIP  =  50; 
SAT  =  85; 
NOISE  =  0; 
FREQ  =  . 1 ; 


variables 

%  Model  initial  condition 
%  Plant  initial  condition 
%  Signal  Amplitude 
%  Simulation  Time 
%  Parameter  variation  time 
%  Control  signal  saturation 
%  Noise  Power 
%  Sin  wave  frequency 


value 
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SWITCH 

Pulse; 


2; 


%  Signals:  1  =  Sin  Wave;  2  =  Step;  3  =  Ramp;  4  = 


%  Run  Simulation 
sim( 'MRAC_sim_TVP' ) 

B.  SIMULINK  DIAGRAM 


Figure  47.  MRAC;  Simulink  Model 
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Figure  48.  MRAC;  Controller 
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Figure  49.  MRAC;  Adaptation  Law 
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Figure  50.  MRAC;  Control  Law 
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Figure  51.  MRAC;  Plant 
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Figure  52.  MRAC;  Time-Varying  Parameters  Switch 
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APPENDIX  B.  Xi  AC  CODE  AND  SIMULATION  MODELS 


A,  MATLAB  CODE 

%%  Ll  AC  with  Time-Varying  Parameters 
%  LT  Nicholas  Valladarez 
%  Naval  Postgraduate  School 
%  December  2014 


clear  all;  close  all;  clc; 
%%  System  Parameters 


%  Dynamic  Coefficients 
ml  =  33.0;  m2  =  ml  +  .02; 

buoy  =  ml*9.81;  %  Buoyancy  [N] 

mg  =  [ml*9.81  m2*9.81];  %  Weight  [N] 

Z_dw  =  -244.3629; 

Z  ww  =  -128.8485; 

a 1  =  [0  0  ]  ; 

a2  =  [Z  ww/ (ml-Z  dw)  Z  ww/ (m2-Z  dw) ] ; 
a3  =  [1/ (ml-Z  dw)  1/ (m2-Z  dw) ] ; 

%  Reformating  Model 
A  =  [al  (1)  ]  ;  B  =  [a3  (1)  ]  ;  C  =  [1]  ; 

Am  =  [-0.4]; 

kg  =  -1/ (C' /Am*B) ; 

Bm  =  B  *  kg ; 


%  Controller  Parameters 
P=lyap (Am' , eye ( 1 ) ) ; 

PB=P*B; 

Gamma  =  5e7; 
k=6; 

Ds_n=[l];  %  Filter 

Ds_d=[l  0];  %  Filter 
K  X  id  =  (Am-A) /B;  %  Ideal  gain 

%K_r_id  =  Bm/B;  %  Ideal  gain 


%  Parameter  Bounds 
Epsilon  =  0.3; 

Omega= [0.3  2.0]; 

Omega_m  =  (Omega (2 ) +0mega ( 1 ) ) /2 ; 
Omega_r  =  (Omega (2 ) -Omega ( 1 )) /2 ; 
Pr_s  =  400; 

Pr_t  =  200; 

K_s0  =  0; 

K_t0  =  0; 

K  oO  =  0; 


Projection  Tolerance 

Bounds  on  actuator  efficiency 


Omega 

proj 

center 

Omega 

proj 

bounds 

Sigma 

proj 

bounds 

Theta 

proj 

bounds 

Sigma 

proj 

IC 

Theta 

proj 

IC 

Omega 

proj 

IC 

%%  Simulation 
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%  Simulation  Variables 


xhatO  =  0; 

g, 

o 

State  estimate  IC 

xO  =  0; 

0, 

o 

State  IC 

r=0.5; 

g, 

o 

Command  amplitude 

TIME  =  30.0; 

q, 

o 

Simulation  time 

TRIP  =  15; 

q, 

o 

TVP  time 

SAT  =  85; 

g, 

o 

Control  signal  saturation  value 

NOISE  =  0; 

q, 

o 

Noise  Power 

FREQ  =  . 1 ; 

g, 

o 

Sin  wave  frequency 

SWITCH  =2; 

g, 

o 

Signals;  1  =  Sin  Wave;  2  =  Step 

Pulse; 

%  Run  Simulation 

sim ( 'Heave_Ll_TVP  sim' ) ; 

B.  SIMULINK  DIAGRAM 
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Figure  54.  L\  AC  Simulink  Model 


Figure  55.  L\  AC;  Controller  Model 
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Figure  56.  L\  AC;  Adaptation  Law 
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Figure  58.  £i  AC;  State  Predictor 
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Figure  60.  L\  AC;  Time-Varying  Parameters  Switeh 


Figure  61 .  L\  AC:  Ideal  Plant 
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APPENDIX  C.  DERIVATION  OF 

For  a  system  of  form; 

x^A^x  +  B{u^^+f{x,t)) 
y-Cx 

assume  u^^{s)  =  C{s){kgR{s)-F{s))  and  C(0)  =  1,  where  F{s)  =  3'{f{x,t)} , 
F{s)  =  Ff{f  {x,t)} ,  and  C{s)F{s)  eaneels  the  effeets  of  F(s) .  The  steady  state  error  is 

e{t)  =  r{t)-y{t) 

-  r{t)  -  Cx(t) 

and 

E(s)  =  ^  {e(0}  =  Ris)  -  Y(s)  =  Ris)  -  CX{s) 

The  Laplace  transform  of  i: : 

sX(s)  =  A„X(s)  +  B(U^,(^)  +  F(s)) 

=  A^X(s)  +  BC(s)k^R(s)  -  BXk^^  +  BFFs) 

Solving  for  X (5) : 

{s-AJX{s)  =  BC{s)k^R{s) 
X{s)^{s-AyBC{s)kR{s) 

Substituting  X(5)  into  E{s)\ 

E(s)  =  R(s)-CX(s) 

=  (l-C(s-AJ-^BC(s)k^)R(s) 

According  to  the  final  value  theorem; 

^  {lim  e(t)}  =  lim  sE(s) 

s^O 
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Also,  to  achieve  zero  steady  state  error  for  a  step  input; 


Ris)  =  ^ 

where  is  the  size  of  the  step  function. 

lim  (i )  =  lim /(\-C(s-AJ-'Bp^'k,)’^ 


Therefore,  for  zero  steady  state  error; 
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